-- Logs begin at Fri 2022-07-29 10:58:39 UTC, end at Fri 2022-07-29 12:10:56 UTC. -- Jul 29 11:37:31.557699 dv-cinder-837542-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 29 11:37:31.566676 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 29 11:37:31.569267 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 11:37:31 2022] *** Jul 29 11:37:31.569267 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 11:37:31.569267 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 11:37:31.569267 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: nodename: dv-cinder-837542-7-iscsi Jul 29 11:37:31.569267 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: machine: x86_64 Jul 29 11:37:31.569267 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: clock source: unix Jul 29 11:37:31.569267 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: pcre jit disabled Jul 29 11:37:31.569267 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: detected number of CPU cores: 4 Jul 29 11:37:31.569267 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: current working directory: / Jul 29 11:37:31.569267 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: detected binary path: /usr/bin/uwsgi-core Jul 29 11:37:31.569921 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: your processes number limit is 47680 Jul 29 11:37:31.569921 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: your memory page size is 4096 bytes Jul 29 11:37:31.569921 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: detected max file descriptor number: 2048 Jul 29 11:37:31.569921 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: lock engine: pthread robust mutexes Jul 29 11:37:31.569921 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: thunder lock: enabled Jul 29 11:37:31.569921 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 29 11:37:31.569921 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 11:37:31.608136 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: Python main interpreter initialized at 0x561ffa7bd9c0 Jul 29 11:37:31.608136 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: python threads support enabled Jul 29 11:37:31.608136 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: your server socket listen backlog is limited to 100 connections Jul 29 11:37:31.608136 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: your mercy for graceful operations on workers is 90 seconds Jul 29 11:37:31.608464 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 11:37:31.608550 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: *** Operational MODE: preforking *** Jul 29 11:37:31.608789 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: *** uWSGI is running in multiple interpreter mode *** Jul 29 11:37:31.608789 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: spawned uWSGI master process (pid: 115055) Jul 29 11:37:31.608969 dv-cinder-837542-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 29 11:37:31.609775 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: spawned uWSGI worker 1 (pid: 115056, cores: 1) Jul 29 11:37:31.609903 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: spawned uWSGI worker 2 (pid: 115057, cores: 1) Jul 29 11:37:31.611843 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 11:37:32.278029 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 11:37:32.281467 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 11:37:33.361845 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 11:37:33.361845 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: from cryptography.utils import int_from_bytes Jul 29 11:37:33.362515 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 11:37:33.362515 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: from cryptography.utils import int_from_bytes Jul 29 11:37:33.365866 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 11:37:33.365866 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: from cryptography.utils import int_from_bytes Jul 29 11:37:33.366336 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 11:37:33.366336 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: from cryptography.utils import int_from_bytes Jul 29 11:37:35.878544 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 11:37:35.879117 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 11:37:35.879205 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 11:37:35.880144 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 11:37:35.880238 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 11:37:35.880402 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 11:37:35.880504 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 11:37:35.880675 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 11:37:35.880780 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 11:37:35.881038 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 11:37:35.881182 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.881389 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.881516 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.881749 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.881851 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.882080 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.882173 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.882418 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.882520 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.882736 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.882838 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.883065 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.883152 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.883394 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.883489 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.883720 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.883810 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.883986 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.884079 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.884308 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.884395 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.884633 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.884728 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837542-7-iscsi {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.884957 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.885042 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837542-7-iscsi {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.885291 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.885395 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.885612 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.885713 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.885931 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.886023 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.886246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.886340 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.886556 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.886656 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.886880 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.886964 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.887191 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.887385 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.887703 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.887848 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.888022 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.888143 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.888335 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.888458 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.888651 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.888832 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.888978 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.889061 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.889301 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.889452 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.889654 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.889742 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.889980 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.890124 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.890295 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.890383 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.890626 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.890968 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.891197 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.891287 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837542-7-iscsi {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.891587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.891683 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837542-7-iscsi {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.891906 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.891992 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.892225 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.892354 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.892542 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.892636 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.892948 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.893082 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.893267 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.893363 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.893605 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.893692 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.893935 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.894066 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.894253 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.894348 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.894568 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.894669 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.894898 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.894983 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.895253 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.895364 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.895577 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.895748 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.895902 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.896065 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.896213 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.896386 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.896520 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.896705 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.896826 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.897037 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.897168 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.897354 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.897490 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.897695 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.897790 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.897955 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.898061 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.898270 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.898374 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.898597 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.898689 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.898925 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.899063 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.899249 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.899338 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.899506 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.899602 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.899759 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.899883 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.900083 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.900168 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.900403 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.900499 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.900714 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.900806 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.901023 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.901109 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.901335 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.901444 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.901670 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.901766 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.901980 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.902066 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.902288 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.902374 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.902597 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.902681 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.902912 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.903043 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.903234 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.903322 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.903552 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.903637 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.903879 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.903973 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.904192 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.904286 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.904511 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.904596 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.904910 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.904994 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.905166 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.905252 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.905503 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.905599 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.905850 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.905952 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.906179 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.906276 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.906493 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.906585 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.906813 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.906909 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.907137 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.907221 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.907449 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.907533 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.907759 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.907852 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.908068 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.908163 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.908391 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.908477 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.908726 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.908819 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.909038 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.909183 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.909289 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.909375 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.909622 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.909712 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.909932 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.910019 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.910253 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.910339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.910564 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.910691 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.910925 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.911151 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.911239 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.911471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.911568 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.911783 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.911870 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.912099 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.912191 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.912414 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.912514 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.912729 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.912822 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.913038 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.913170 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.913345 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.913503 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.913682 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.913774 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.913993 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.914078 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.914302 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.914398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.914614 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.914700 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.914939 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.915024 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.915253 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.915352 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.915563 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.915655 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.915870 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.915969 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.916184 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.916272 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.916498 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.916586 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.916806 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.916905 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.917117 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.917217 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.917441 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.917540 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.917765 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.917857 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.918076 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.918164 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.918387 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.918479 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.918700 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.918784 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.919011 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.919097 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.919326 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.919411 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.919629 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.919714 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.919941 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.920036 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.920252 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.920343 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.920562 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.920647 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.920873 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.921003 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.921177 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.921269 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.921509 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.921611 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.921819 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.921905 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.922125 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.922210 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.922430 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.922523 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.922734 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.922827 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.923036 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.923127 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.923338 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.923434 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.923665 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.923753 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.923976 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.924070 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.924287 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.924383 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.924597 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.924683 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.924911 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.924998 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.925237 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:37:35.925342 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.925596 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.925683 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.925939 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.926039 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.926257 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.926854 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.927117 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.927209 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.927457 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.927553 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.927800 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.927892 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.928125 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.928211 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.928448 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.928548 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.928771 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.928865 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.929084 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.929176 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.929403 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.929527 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.929743 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.929836 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.930064 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.930156 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.930387 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.930480 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.930715 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.930815 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.931037 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.931123 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.931359 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.931457 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.931683 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.931768 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.932005 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.932092 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.932320 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.932414 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.932645 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.932736 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.932971 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.933056 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.933297 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.933393 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.933644 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.933741 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.933995 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.934081 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.934316 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.934410 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.934651 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.934739 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.934977 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.935062 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.935294 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.935388 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.935610 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.935696 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.935924 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.936048 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.936239 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.936329 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.936568 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.936662 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.936884 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.936970 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.937212 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.937299 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.937558 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.937647 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.937876 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.937973 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.938192 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.938279 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.938508 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.938599 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.938824 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.938923 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.939139 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.939232 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.939475 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.939561 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.939796 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.939889 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.940112 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.940198 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.940430 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.940515 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.940747 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.940845 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.941063 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.941148 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.941377 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.941513 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.941716 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.941816 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.942588 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.942713 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.943013 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.943099 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.943337 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.943478 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.943650 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.943737 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.943958 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.944051 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.944289 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.944377 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.944603 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.944690 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.944926 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.945013 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.945245 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.945332 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.945590 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.945680 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.945906 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.945991 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.946220 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.946314 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.946536 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.946622 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.946851 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.946936 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.947166 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.947253 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.947481 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.947567 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.947789 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.947887 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.948117 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.948203 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.948428 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.948521 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.948741 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.948837 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.949053 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.949139 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.949367 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.949480 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.949705 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.949805 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.950023 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.950109 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.950336 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.950420 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.950651 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.950747 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.950967 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.951053 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.951287 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.951372 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.951604 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.951699 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.951925 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.952017 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.952244 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.952331 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.952587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.952682 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.952896 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.952981 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.953223 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.953315 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.953575 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.953665 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.953902 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.953989 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.954215 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.954313 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.954522 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.954607 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.954831 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.954917 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.955139 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.955232 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.955449 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.955535 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.955755 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.955847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.956062 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.956156 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.956368 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.956465 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.956677 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.956762 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.956982 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.957126 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.957291 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.957377 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.957666 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.957763 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.957984 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.958078 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.958297 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.958386 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.958604 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.958688 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.958911 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.959006 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.959216 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.959309 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.959559 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.959645 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.959868 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.959954 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.960215 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.960303 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.960544 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.960631 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.960867 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.960961 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.961183 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.961269 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.961531 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.961632 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.961853 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.961942 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.962169 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.962254 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.962485 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.962585 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.962799 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.962884 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.963118 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.963204 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.963435 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.963535 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.963749 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.963868 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.964065 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.964152 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.964378 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.964474 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.964696 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.964788 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.965010 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.965103 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.965319 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.965461 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.965661 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.965746 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.965990 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.966103 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.966337 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.966433 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.966663 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.966767 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.966981 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.967069 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.967296 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.967386 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.967619 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.967746 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.967932 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.968030 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.968244 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.968331 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.968560 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.968645 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.968881 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.968990 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.969183 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.969279 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.969521 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.969610 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.969838 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.969922 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.970153 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.970247 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.970464 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.970550 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.970784 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.970879 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.971098 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.971184 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.971409 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.971495 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.971721 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.971816 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.972042 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.972130 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.972377 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.972463 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.972690 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.972785 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.973016 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.973104 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.973431 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.973612 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.973834 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.973957 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.974040 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.974120 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.974355 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.974443 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.974668 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.974757 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.974981 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.975067 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.975295 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.975389 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.975619 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.975708 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.975939 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.976025 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.976257 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.976343 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.976571 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.976660 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.976884 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.976971 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.977199 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.977285 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.977541 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.977644 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.977852 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.977942 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.978160 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.978256 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.978480 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.978567 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.978795 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.978879 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.979110 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.979205 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.979437 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.979525 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.979750 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.979850 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.980060 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.980154 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.980374 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.980461 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.980686 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.980772 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.980998 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.981094 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.981307 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.981393 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.981640 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.981730 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.981950 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.982036 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.982295 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.982380 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.982606 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.982692 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.982912 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.983000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.983236 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.983324 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.983556 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.983641 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.983869 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.983955 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.984185 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.984269 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.984500 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.984585 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.984815 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.984911 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.985137 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.985230 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.985479 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.985582 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.985798 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.985885 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.986113 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.986205 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.986426 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.986521 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.986742 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.986834 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.987061 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.987148 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.987377 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.987471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.987690 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.987774 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.988008 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.988101 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.988321 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.988415 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.988634 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.988720 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.989493 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.989656 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.989816 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.990152 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.990383 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.990502 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.990725 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.990820 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.991051 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.991148 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.991378 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.991465 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.991703 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.991798 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.992031 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.992127 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.992368 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.992457 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.992704 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.992791 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.993057 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.993234 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.993372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.993492 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.993714 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.993801 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.994024 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.994124 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.994338 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.994426 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.994650 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.994736 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.994960 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.995047 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.995271 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.995366 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.995579 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.995667 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.995889 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.995976 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.996195 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.996295 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.996504 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.996590 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.996808 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.996903 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.997119 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.997208 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.997468 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.997559 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.997767 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.997863 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.998078 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.998174 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.998386 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.998472 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.998710 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.998805 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.999023 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.999109 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.999331 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.999416 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.999637 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.999731 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:35.999950 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.000037 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.000280 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.000373 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.000595 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.000683 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.000942 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.001029 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.001279 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.001365 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.001616 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.001705 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.001933 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.002028 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.002263 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.002349 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.002571 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.002658 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.002884 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.002970 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.003190 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.003276 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.003502 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.003590 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.003813 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.003898 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.004124 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.004208 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.004511 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.004601 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.004937 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.005066 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.005259 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.005358 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.005601 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.005691 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.005915 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.006003 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.006222 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.006317 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.006534 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.006620 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.006843 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.006928 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.007157 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.007255 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.007470 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.007555 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.007776 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.007868 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.008081 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.008177 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.008393 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.008479 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.008705 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.008798 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.009016 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.009106 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.009322 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.009431 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.009666 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.009752 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.009975 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.010062 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.010284 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.010370 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.010590 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.010682 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.010897 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.010984 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.011208 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.011293 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.011519 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.011617 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.011826 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.011912 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.012150 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.012242 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.012464 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.012558 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.012771 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.012857 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.013078 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.013162 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.013392 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.013525 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.013723 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.013810 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.014029 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.014113 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.014346 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.014443 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.014666 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.014752 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.014979 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.015065 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.015285 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.015379 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.015595 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.015932 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.016160 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.016246 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.016469 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.016563 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.016777 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.016914 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.017083 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.017169 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.017391 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.017540 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.017722 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.017809 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.018030 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.018115 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.018337 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.018425 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.018647 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.018735 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.018960 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.019055 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.019272 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.019357 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.019579 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.019665 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.019886 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.019980 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.020714 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.020850 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.021067 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.021162 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.021378 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.021596 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.021766 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.021855 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.022079 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.022165 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.022403 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.022504 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.022732 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.022822 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.023051 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.023137 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.023371 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.023465 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.023688 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.023772 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.023999 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.024085 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.024314 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.024401 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.024627 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.024723 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.024936 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.025029 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.025245 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.025338 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.025597 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.025685 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.025915 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.026000 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.026230 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.026317 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.026548 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.026635 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.026876 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.026999 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.027201 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.027288 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.027510 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.027591 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.027833 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.027956 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.028148 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.028237 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.028459 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.028551 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.028768 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.028874 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.029081 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.029180 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.029393 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.029504 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.029730 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.029839 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.030045 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.030135 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.030362 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.030453 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.030676 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.030777 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.030989 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.031079 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.031299 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.031398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.031611 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.031704 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.031922 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.032019 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.032235 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.032327 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.032553 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.032665 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.032869 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.032981 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.033180 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.033270 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.033515 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.033618 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.033831 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.033920 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.034138 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.034225 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.034444 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.034577 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.034878 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.034974 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.035195 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.035292 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.035506 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.035593 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.035932 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.036028 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.036259 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.036507 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.036607 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.036838 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.036927 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.037167 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.037254 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.037509 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.037601 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.037942 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.038027 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.038260 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.038345 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.038575 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.038670 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.038891 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.038978 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.039200 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.039294 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.039509 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.039596 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.039821 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.039906 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.040149 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.040244 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.040458 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.040551 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.040771 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.040871 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.041080 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.041180 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.041405 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.041510 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.041738 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.041844 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.042061 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.042163 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.042485 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.042583 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.042800 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.042904 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.043111 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.043212 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.043528 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.043614 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.043852 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.043953 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.044165 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.044445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.044577 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.044805 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.048231 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.048337 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.048337 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.048496 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.048577 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.048678 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.048769 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.048849 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.048928 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.049014 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.049106 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.049187 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.049266 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.049344 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.049478 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.049563 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.049656 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.049737 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.049816 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.049904 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.049985 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.050071 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.050152 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.050238 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.050325 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.050404 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.050404 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.050556 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.050636 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.050715 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.050715 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.050874 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.050956 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.051043 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.051124 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.051202 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.051287 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.051869 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.051952 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.052032 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.052114 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.052181 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.052580 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.053107 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.053255 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.053449 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.053539 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.053780 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.053878 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.054099 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.054204 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.054422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.054509 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.054744 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.054832 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.055062 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.055158 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.055376 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.055462 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.055689 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.055782 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.056004 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.056106 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.056314 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.056400 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.056634 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.056721 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.056955 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.057050 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.057275 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.057361 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.057636 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.057736 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.057960 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.058058 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.058272 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.058359 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.058596 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.058682 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.058913 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.059001 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.059223 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.059309 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.059534 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.059656 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.059848 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.059939 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.060180 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.060266 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.060500 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.060595 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.060832 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.060921 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.061164 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.061249 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.061508 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.061613 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.061827 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.061951 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.062172 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.062263 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.062496 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.062604 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.062820 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.062908 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.063142 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.063236 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.063452 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.063591 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.063767 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.063856 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.064078 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.064164 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.064388 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.064483 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.064698 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.064828 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.065008 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.065094 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.065318 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.065405 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.065661 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.065748 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.065969 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.066056 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.066278 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.066366 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.066592 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.066693 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.066901 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.067056 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.067790 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.067886 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.068124 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.068218 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.068443 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.068540 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.068756 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.068846 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.069071 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.069168 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.069384 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.069504 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.069761 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.069856 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.070075 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.070164 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.070417 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.070514 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.070742 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.070838 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.071074 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.071161 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.071390 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.071552 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.071713 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.071800 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.072037 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.072122 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.072360 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.072447 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.072681 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.072769 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.073002 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.073090 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.073323 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.073469 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.073697 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.073794 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.074024 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.074111 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.074343 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.074432 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.074661 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.074748 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.074982 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.075077 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.075306 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.075394 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.075634 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.075850 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.076179 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.076275 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.076499 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.076592 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.076823 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.076911 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.077144 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.077238 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.077487 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.077577 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.077814 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.077912 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.078133 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.078232 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.078450 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.078536 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.078767 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.078854 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.079082 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.079171 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.079415 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.079559 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.079731 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.079859 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.080060 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.080148 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.080395 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.080482 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.080715 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.080808 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.081040 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.081136 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.081359 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.081478 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.081707 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.081804 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.082027 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.082115 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.082381 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.082474 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.082747 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.082835 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.083067 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.083154 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.083391 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.083486 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.083712 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.083808 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.084032 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.084120 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.084346 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.084432 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.084661 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.084749 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.084977 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.085063 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.085296 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.085382 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.085637 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.085734 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.085954 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.086040 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.086274 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.086368 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.086592 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.086678 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.086926 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.087021 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.087254 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.087350 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.087577 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.087664 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.087895 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.087988 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.088218 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.088328 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.088539 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.088747 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.089069 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.089157 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.089398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.089547 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.089758 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.089844 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.090094 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.090199 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.090420 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.090509 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.090743 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.090836 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.091069 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.091156 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.091381 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.091469 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.091694 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.091781 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.092005 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.092092 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.092318 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.092412 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.092630 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.092718 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.092937 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.093031 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.093263 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.093349 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.093610 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.093698 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.093925 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.094029 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.094238 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.094324 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.094558 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.094779 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.095095 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.095191 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.095448 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.095543 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.095774 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.095862 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.096105 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.096193 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.096432 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.096519 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.096750 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.096839 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.097061 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.097149 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.097387 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.097538 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.097724 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.097811 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.098040 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.098129 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.098426 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.098521 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.098745 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.098833 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.099061 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.099149 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.099371 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.099458 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.099685 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.099781 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.099996 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.100083 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.100310 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.100399 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.100618 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.100714 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.100927 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.101013 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.101251 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.101336 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.101588 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.101693 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.101900 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.101987 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.102207 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.102294 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.102517 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.102612 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.102825 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.102956 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.103134 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.103228 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.103444 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.103540 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.103760 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.103846 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.104073 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.104159 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.104381 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.104469 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.104690 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.104775 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.105002 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.105088 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.105309 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.105396 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.105652 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.105742 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.105969 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.106054 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.106326 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.106415 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.106638 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.106725 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.106950 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.107038 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.107260 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.107348 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.107572 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.107658 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.107890 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.107984 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.108214 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.108309 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.108530 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.108615 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.108850 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.109014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.109188 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.109274 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.109546 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.109758 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.110090 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.110238 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.110414 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.110508 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.110746 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.110832 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.111083 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.111183 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.111400 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.111488 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.111715 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.111803 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.112028 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.112116 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.112344 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.112432 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.112658 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.112742 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.112977 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.113067 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.113294 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.113379 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.113637 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.113736 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.114472 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.114604 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.114792 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.114991 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.115110 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.115313 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.115410 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.115632 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.115721 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.115954 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.116041 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.116273 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.116362 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.116592 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.116680 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.116912 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.116999 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.117226 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.117314 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.117576 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.117678 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.117894 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.117991 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.118219 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.118353 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.118552 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.118637 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.118875 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.118970 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.119196 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.119292 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.119511 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.119597 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.119828 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.119926 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.120142 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.120272 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.120456 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.120542 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.120770 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.120867 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.121091 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.121180 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.121409 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.121529 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.121749 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.121839 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.122078 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.122171 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.122393 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.122481 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.122790 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.122880 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.123118 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.123212 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.123435 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.123531 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.123762 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.123849 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.124088 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.124175 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.124406 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.124508 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.124734 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.124821 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.125048 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.125134 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.125374 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.125486 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.125719 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.125813 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.126059 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.126191 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.126397 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.126493 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.126712 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.126799 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.127025 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.127113 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.127337 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.127426 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.127650 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.127736 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.127965 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.128062 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.128285 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.128374 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.128642 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.128735 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.128904 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.128992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.129214 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.129302 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.130085 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.130180 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.130402 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.130501 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.130719 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.130806 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.131033 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.131120 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.131352 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.131452 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.131665 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.131752 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.131978 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.132064 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.132286 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.132386 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.132595 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.132719 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.132904 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.132991 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.133215 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.133309 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.133555 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.133643 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.133866 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.133954 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.134181 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.134270 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.134492 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.134578 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.134800 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.134886 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.135108 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.135196 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.135422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.135518 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.135734 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.135829 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.136073 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.136162 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.136401 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.136486 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.136721 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.136808 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.137047 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.137143 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.137365 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.137503 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.137759 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.137858 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.138088 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.138174 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.138410 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.138496 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.138729 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.138825 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.139049 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.139142 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.139368 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.139457 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.139685 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.139850 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.140007 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.140093 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.140321 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.140408 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.140636 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.140985 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.141208 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.141306 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.141561 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.141654 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.141874 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.141964 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.142188 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.142281 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.142521 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.142610 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.142832 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.142920 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.143158 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.143244 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.143478 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.143564 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.143792 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.143881 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.144119 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.144204 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.144433 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.144527 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.144753 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.144846 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.145093 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.145184 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.145445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.145548 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.145756 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.145924 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.146080 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.146249 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.146399 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.146570 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.146704 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.146896 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.147028 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.147215 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.147350 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.147534 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.147686 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.147859 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.148025 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.148183 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.148344 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.148519 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.148680 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.148851 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.149015 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.149170 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.149370 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.149528 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.149729 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.149864 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.150083 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.150221 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.150422 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.150545 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.150745 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.150897 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.151066 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.151238 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.151382 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.151562 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.151650 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 11:37:36.151884 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.152198 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:37:36.152448 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 11:37:36.307069 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO dbcounter [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] Registered counter for database nova_api Jul 29 11:37:36.307367 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO dbcounter [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] Registered counter for database nova_api Jul 29 11:37:36.327839 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_db.sqlalchemy.engines [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115057) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:37:36.330821 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG oslo_db.sqlalchemy.engines [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115056) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:37:36.335197 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG dbcounter [-] [115057] Writer thread running {{(pid=115057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:37:36.337994 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG dbcounter [-] [115056] Writer thread running {{(pid=115056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:37:36.391213 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.context [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),606e82e5-84db-457f-9bee-6019fb6dd605(cell1) {{(pid=115057) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 11:37:36.392906 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.context [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),606e82e5-84db-457f-9bee-6019fb6dd605(cell1) {{(pid=115056) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 11:37:36.395181 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:37:36.397271 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:37:36.397659 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG oslo_concurrency.lockutils [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:37:36.398093 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:37:36.399252 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG oslo_concurrency.lockutils [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:37:36.400040 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG oslo_concurrency.lockutils [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:37:36.400142 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:37:36.402008 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG oslo_concurrency.lockutils [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:37:36.402124 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO dbcounter [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] Registered counter for database nova_cell0 Jul 29 11:37:36.403968 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO dbcounter [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] Registered counter for database nova_cell0 Jul 29 11:37:36.407470 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO dbcounter [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] Registered counter for database nova_cell1 Jul 29 11:37:36.409532 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO dbcounter [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] Registered counter for database nova_cell1 Jul 29 11:37:36.414492 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_db.sqlalchemy.engines [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115057) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:37:36.416050 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG oslo_db.sqlalchemy.engines [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115056) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:37:36.419243 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG dbcounter [-] [115057] Writer thread running {{(pid=115057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:37:36.420845 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG dbcounter [-] [115056] Writer thread running {{(pid=115056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:37:36.421536 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG oslo_db.sqlalchemy.engines [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115056) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:37:36.423653 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_db.sqlalchemy.engines [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115057) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:37:36.559903 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG dbcounter [-] [115056] Writer thread running {{(pid=115056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:37:36.561915 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG dbcounter [-] [115057] Writer thread running {{(pid=115057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:37:36.569053 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO dbcounter [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] Registered counter for database nova_cell0 Jul 29 11:37:36.571679 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO dbcounter [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] Registered counter for database nova_cell0 Jul 29 11:37:36.576206 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG oslo_db.sqlalchemy.engines [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115056) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:37:36.580062 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_db.sqlalchemy.engines [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115057) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:37:36.580648 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG dbcounter [-] [115056] Writer thread running {{(pid=115056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:37:36.584969 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG dbcounter [-] [115057] Writer thread running {{(pid=115057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:37:36.918358 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: WARNING keystonemiddleware.auth_token [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 11:37:36.923011 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: WARNING keystonemiddleware.auth_token [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 11:37:36.925562 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: WARNING keystonemiddleware.auth_token [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 11:37:36.931043 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: WARNING keystonemiddleware.auth_token [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 11:37:37.265517 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: WARNING keystonemiddleware.auth_token [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 11:37:37.272318 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: WARNING keystonemiddleware.auth_token [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 11:37:37.274578 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: WARNING keystonemiddleware.auth_token [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 11:37:37.277572 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561ffa7bd9c0 pid: 115057 (default app) Jul 29 11:37:37.279626 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:37:37.280497 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: WARNING keystonemiddleware.auth_token [None req-18277cd3-7c64-4a99-a428-9f3286f4797e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 11:37:37.280810 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001720 Jul 29 11:37:37.281221 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Fri Jul 29 11:37:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:37:37.285992 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561ffa7bd9c0 pid: 115056 (default app) Jul 29 11:38:52.667729 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:38:52.669558 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002152 Jul 29 11:38:52.670111 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 930 bytes} [Fri Jul 29 11:38:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:38:52.683317 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG dbcounter [-] [115056] Writing DB stats nova_api:SELECT=3 {{(pid=115056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:52.687074 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG dbcounter [-] [115056] Writing DB stats nova_cell0:SELECT=3 {{(pid=115056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:52.688596 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG dbcounter [-] [115056] Writing DB stats nova_cell1:SELECT=3 {{(pid=115056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:52.691727 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG dbcounter [-] [115056] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:53.571371 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-8e48d04e-b3b1-4620-bbd2-d1f299572176 admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:38:53.602954 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-8e48d04e-b3b1-4620-bbd2-d1f299572176 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.925060 Jul 29 11:38:53.603776 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1291 bytes} [Fri Jul 29 11:38:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:38:55.826155 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:38:55.827553 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-53ded7e0-15ea-4dd6-a67d-dc781f96ee76 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001888 Jul 29 11:38:55.828808 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 930 bytes} [Fri Jul 29 11:38:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:38:56.312808 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-d7632dba-716c-4fcb-a581-b5b7edecc88d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:38:56.335093 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:38:56.335093 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: warnings.warn(msg) Jul 29 11:38:56.364064 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-d7632dba-716c-4fcb-a581-b5b7edecc88d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.528555 Jul 29 11:38:56.366983 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1282 bytes} [Fri Jul 29 11:38:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 11:38:56.591639 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-e8e1a78f-cd1c-4076-83d1-f9514e935372 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:38:56.596192 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:38:56.596192 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: warnings.warn(msg) Jul 29 11:38:56.599076 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG dbcounter [-] [115057] Writing DB stats nova_api:SELECT=3 {{(pid=115057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:56.599990 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG dbcounter [-] [115057] Writing DB stats nova_cell1:SELECT=3 {{(pid=115057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:56.600984 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG dbcounter [-] [115057] Writing DB stats nova_cell0:SELECT=3 {{(pid=115057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:56.601858 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG dbcounter [-] [115057] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:38:56.665822 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-e8e1a78f-cd1c-4076-83d1-f9514e935372 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292330 Jul 29 11:38:56.677934 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1335 bytes} [Fri Jul 29 11:38:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:38:58.932480 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-d7632dba-716c-4fcb-a581-b5b7edecc88d admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:38:58.933682 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-d7632dba-716c-4fcb-a581-b5b7edecc88d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 29 11:38:58.934087 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 930 bytes} [Fri Jul 29 11:38:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:38:59.593989 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-b63f3438-2d6c-4cd4-8e38-f635fc7f3807 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:38:59.614415 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:38:59.614415 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: warnings.warn(msg) Jul 29 11:38:59.635297 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-b63f3438-2d6c-4cd4-8e38-f635fc7f3807 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.694430 Jul 29 11:38:59.636331 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1282 bytes} [Fri Jul 29 11:38:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 11:38:59.648720 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-739dfef4-da7b-42a8-a8c2-e71b209a1334 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:38:59.652530 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:38:59.652530 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: warnings.warn(msg) Jul 29 11:38:59.689900 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-739dfef4-da7b-42a8-a8c2-e71b209a1334 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045003 Jul 29 11:38:59.691231 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1335 bytes} [Fri Jul 29 11:38:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:39:01.889008 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-b63f3438-2d6c-4cd4-8e38-f635fc7f3807 admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:01.890057 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-b63f3438-2d6c-4cd4-8e38-f635fc7f3807 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jul 29 11:39:01.890474 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 930 bytes} [Fri Jul 29 11:39:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:39:02.320977 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-775adc3f-dc27-4e42-bd67-b52a5c4cec0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:02.340693 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-775adc3f-dc27-4e42-bd67-b52a5c4cec0f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444116 Jul 29 11:39:02.341242 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1282 bytes} [Fri Jul 29 11:39:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 11:39:02.353713 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-1bbf11c3-a29a-43c8-8d65-1070d0263413 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:02.378441 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-1bbf11c3-a29a-43c8-8d65-1070d0263413 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028604 Jul 29 11:39:02.379019 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1335 bytes} [Fri Jul 29 11:39:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:39:04.586024 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-775adc3f-dc27-4e42-bd67-b52a5c4cec0f admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:04.587037 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-775adc3f-dc27-4e42-bd67-b52a5c4cec0f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Jul 29 11:39:04.587448 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 930 bytes} [Fri Jul 29 11:39:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:39:05.009478 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-73bb1193-f279-4c14-811a-df8e0d2e0a7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "swap": 0, "id": "d3", "os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "rxtx_factor": 1.0}} {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:05.030431 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-73bb1193-f279-4c14-811a-df8e0d2e0a7d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436019 Jul 29 11:39:05.030980 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1282 bytes} [Fri Jul 29 11:39:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 11:39:05.042944 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-78ffd32a-420f-4156-8f8b-591c7ca74800 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:05.085216 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-78ffd32a-420f-4156-8f8b-591c7ca74800 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045998 Jul 29 11:39:05.089843 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1335 bytes} [Fri Jul 29 11:39:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:39:07.340580 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-73bb1193-f279-4c14-811a-df8e0d2e0a7d admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:07.341632 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-73bb1193-f279-4c14-811a-df8e0d2e0a7d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 29 11:39:07.342210 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 930 bytes} [Fri Jul 29 11:39:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:39:07.788422 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-cc56c39b-7e56-450c-9390-cd489496a0a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "disk": 20}} {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:07.808692 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-cc56c39b-7e56-450c-9390-cd489496a0a4 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.460883 Jul 29 11:39:07.809746 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1282 bytes} [Fri Jul 29 11:39:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 11:39:07.821959 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-fd3d9bb1-e637-43fd-8710-a7a6c5375818 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:07.847770 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-fd3d9bb1-e637-43fd-8710-a7a6c5375818 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029439 Jul 29 11:39:07.848499 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1335 bytes} [Fri Jul 29 11:39:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:39:10.344339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-cc56c39b-7e56-450c-9390-cd489496a0a4 admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:10.345474 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-cc56c39b-7e56-450c-9390-cd489496a0a4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Jul 29 11:39:10.345894 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 930 bytes} [Fri Jul 29 11:39:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:39:10.791409 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-3f159131-7afe-4a11-8728-563950297540 admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:10.817390 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-3f159131-7afe-4a11-8728-563950297540 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.465129 Jul 29 11:39:10.817996 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1291 bytes} [Fri Jul 29 11:39:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:39:13.628329 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-cc56c39b-7e56-450c-9390-cd489496a0a4 admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:13.629352 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-cc56c39b-7e56-450c-9390-cd489496a0a4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 29 11:39:13.629788 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 930 bytes} [Fri Jul 29 11:39:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:39:14.083959 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-5b93de41-5bdd-4c0d-bf1d-a8ee1898d00e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1"}} {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:14.104603 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-5b93de41-5bdd-4c0d-bf1d-a8ee1898d00e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.467996 Jul 29 11:39:14.105252 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1282 bytes} [Fri Jul 29 11:39:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 11:39:14.118917 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-de44aa33-4fcd-45d2-b8d6-96fd32632777 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:14.149286 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-de44aa33-4fcd-45d2-b8d6-96fd32632777 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035012 Jul 29 11:39:14.150318 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1332 bytes} [Fri Jul 29 11:39:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:39:16.399987 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-5b93de41-5bdd-4c0d-bf1d-a8ee1898d00e admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:16.401005 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-5b93de41-5bdd-4c0d-bf1d-a8ee1898d00e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jul 29 11:39:16.401435 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 930 bytes} [Fri Jul 29 11:39:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:39:16.793556 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-3e4612ea-39a4-4004-988a-bd2e003b0e7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048, "swap": 0, "disk": 20}} {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:16.813442 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-3e4612ea-39a4-4004-988a-bd2e003b0e7e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.406123 Jul 29 11:39:16.820988 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1282 bytes} [Fri Jul 29 11:39:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 11:39:16.826063 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-04aa12f1-83e7-43c3-84f2-5db9c71a8745 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:16.850445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-04aa12f1-83e7-43c3-84f2-5db9c71a8745 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028030 Jul 29 11:39:16.851017 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1332 bytes} [Fri Jul 29 11:39:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:39:19.054065 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-3e4612ea-39a4-4004-988a-bd2e003b0e7e admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:19.055083 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-3e4612ea-39a4-4004-988a-bd2e003b0e7e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 29 11:39:19.055493 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 930 bytes} [Fri Jul 29 11:39:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:39:19.459164 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-151b02cc-2f36-481b-a92f-f39eab08768b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:19.482153 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-151b02cc-2f36-481b-a92f-f39eab08768b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.420713 Jul 29 11:39:19.482817 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1282 bytes} [Fri Jul 29 11:39:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 11:39:19.495853 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-8d9ff158-4759-4a81-8c08-d762106b8044 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:19.522306 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-8d9ff158-4759-4a81-8c08-d762106b8044 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030224 Jul 29 11:39:19.523036 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1332 bytes} [Fri Jul 29 11:39:19 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:39:21.772280 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-151b02cc-2f36-481b-a92f-f39eab08768b admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:21.773303 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-151b02cc-2f36-481b-a92f-f39eab08768b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 29 11:39:21.773758 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 930 bytes} [Fri Jul 29 11:39:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:39:22.212240 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-675eb6db-553a-49a1-871c-aae5e292d190 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "4", "ram": 8192, "name": "m1.large", "disk": 80, "vcpus": 4}} {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:22.233272 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-675eb6db-553a-49a1-871c-aae5e292d190 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.453118 Jul 29 11:39:22.234416 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1282 bytes} [Fri Jul 29 11:39:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 11:39:22.246664 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-b5470cfd-8aa1-4f3d-9e30-d8c5446f6ad1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:22.277078 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-b5470cfd-8aa1-4f3d-9e30-d8c5446f6ad1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034037 Jul 29 11:39:22.278008 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1332 bytes} [Fri Jul 29 11:39:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:39:24.615321 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-675eb6db-553a-49a1-871c-aae5e292d190 admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:24.616336 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-675eb6db-553a-49a1-871c-aae5e292d190 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 29 11:39:24.616740 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 930 bytes} [Fri Jul 29 11:39:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:39:25.061061 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-776793f0-d769-4850-b3ae-7d7aac7e9358 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true}} {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:25.084623 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-776793f0-d769-4850-b3ae-7d7aac7e9358 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.462015 Jul 29 11:39:25.085285 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1282 bytes} [Fri Jul 29 11:39:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 11:39:25.099158 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-fc80d732-4197-4fbc-9ce3-bf2525f3e3f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:25.105721 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG dbcounter [-] [115056] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=115056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:25.132646 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-fc80d732-4197-4fbc-9ce3-bf2525f3e3f0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039114 Jul 29 11:39:25.133402 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1332 bytes} [Fri Jul 29 11:39:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:39:44.300365 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-776793f0-d769-4850-b3ae-7d7aac7e9358 admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:44.301384 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-776793f0-d769-4850-b3ae-7d7aac7e9358 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 29 11:39:44.301812 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 930 bytes} [Fri Jul 29 11:39:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:39:44.313181 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG dbcounter [-] [115056] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=115056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:44.698392 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-b6a97a41-a17d-4388-ba3a-f9124bb1c18e admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:44.716745 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-b6a97a41-a17d-4388-ba3a-f9124bb1c18e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.408746 Jul 29 11:39:44.717284 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1291 bytes} [Fri Jul 29 11:39:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:39:45.793647 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-776793f0-d769-4850-b3ae-7d7aac7e9358 admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:45.794653 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-776793f0-d769-4850-b3ae-7d7aac7e9358 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 29 11:39:45.795052 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Jul 29 11:39:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:39:46.314963 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-60c09235-bcb3-4845-8fab-24bf29ee5bf8 admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:46.320572 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.wsgi [None req-60c09235-bcb3-4845-8fab-24bf29ee5bf8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-60c09235-bcb3-4845-8fab-24bf29ee5bf8 admin admin] Request method failure captured: Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Accept: application/json Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Accept-Encoding: gzip, deflate Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Connection: keep-alive Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Content-Length: 0 Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Host: 10.222.0.60 Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Openstack-Api-Version: compute 2.90 Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Openstack-System-Scope: None Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: User-Agent: python-novaclient Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Auth-Token: gAAAAABi48cBZzp5375RmbgWg673iH6ZTLIk-UQz4Zmgx7Aw-Gy1UKtSD2XCZJdAbUkIlO_DFqxz8DIQp_sfWbBZToeIfe8-tifCoBM3jRIO3i7I0ecCWkDUInalxe95g7ajOWDXkhXRAY-1u0BKO2BRwbwtTVsCC1TIwzyhwjqzU2csiiDzPSk Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Domain-Id: None Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Domain-Name: None Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Identity-Status: Confirmed Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Is-Admin-Project: True Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Project-Domain-Id: default Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Project-Domain-Name: Default Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Project-Id: b9c00e3cb2134915b18b1a5e5538e94a Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Project-Name: admin Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Role: reader,member,admin Jul 29 11:39:46.323841 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Roles: reader,member,admin Jul 29 11:39:46.325464 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b9c00e3cb2134915b18b1a5e5538e94a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:39:46.325464 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Tenant: admin Jul 29 11:39:46.325464 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Tenant-Id: b9c00e3cb2134915b18b1a5e5538e94a Jul 29 11:39:46.325464 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Tenant-Name: admin Jul 29 11:39:46.325464 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-User: admin Jul 29 11:39:46.325464 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-User-Domain-Id: default Jul 29 11:39:46.325464 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-User-Domain-Name: Default Jul 29 11:39:46.325464 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-User-Id: 0086f32849da40e39473b6be830b5501 Jul 29 11:39:46.325464 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-User-Name: admin Jul 29 11:39:46.325464 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: method: > Jul 29 11:39:46.325464 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: exception: Flavor 42 could not be found. Jul 29 11:39:46.325464 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: action_args: {'id': '42'} Jul 29 11:39:46.325464 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:39:46.325464 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:39:46.326471 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Jul 29 11:39:46.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-60c09235-bcb3-4845-8fab-24bf29ee5bf8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:39:46.329908 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-60c09235-bcb3-4845-8fab-24bf29ee5bf8 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393420 Jul 29 11:39:46.329908 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Fri Jul 29 11:39:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:46.335583 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-0280ce14-f9db-476b-9c12-52c085791132 admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:46.339653 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG dbcounter [-] [115057] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:39:46.359873 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-0280ce14-f9db-476b-9c12-52c085791132 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027799 Jul 29 11:39:46.360417 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Jul 29 11:39:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:39:46.370014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-7b8dc424-220c-4a05-8b24-9a83071907ba admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:46.394825 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-7b8dc424-220c-4a05-8b24-9a83071907ba admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028316 Jul 29 11:39:46.395372 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Jul 29 11:39:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:39:46.404615 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-d43176f6-3c14-4389-9cf7-f87491a7a26c admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:46.411614 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.wsgi [None req-d43176f6-3c14-4389-9cf7-f87491a7a26c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-d43176f6-3c14-4389-9cf7-f87491a7a26c admin admin] Request method failure captured: Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Accept: application/json Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Accept-Encoding: gzip, deflate Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Connection: keep-alive Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Content-Length: 0 Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Host: 10.222.0.60 Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Openstack-Api-Version: compute 2.90 Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Openstack-System-Scope: None Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: User-Agent: python-novaclient Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Auth-Token: gAAAAABi48cBZzp5375RmbgWg673iH6ZTLIk-UQz4Zmgx7Aw-Gy1UKtSD2XCZJdAbUkIlO_DFqxz8DIQp_sfWbBZToeIfe8-tifCoBM3jRIO3i7I0ecCWkDUInalxe95g7ajOWDXkhXRAY-1u0BKO2BRwbwtTVsCC1TIwzyhwjqzU2csiiDzPSk Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Domain-Id: None Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Domain-Name: None Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Identity-Status: Confirmed Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Is-Admin-Project: True Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Project-Domain-Id: default Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Project-Domain-Name: Default Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Project-Id: b9c00e3cb2134915b18b1a5e5538e94a Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Project-Name: admin Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Role: reader,member,admin Jul 29 11:39:46.414992 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Roles: reader,member,admin Jul 29 11:39:46.416477 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b9c00e3cb2134915b18b1a5e5538e94a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:39:46.416477 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Tenant: admin Jul 29 11:39:46.416477 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Tenant-Id: b9c00e3cb2134915b18b1a5e5538e94a Jul 29 11:39:46.416477 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Tenant-Name: admin Jul 29 11:39:46.416477 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-User: admin Jul 29 11:39:46.416477 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-User-Domain-Id: default Jul 29 11:39:46.416477 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-User-Domain-Name: Default Jul 29 11:39:46.416477 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-User-Id: 0086f32849da40e39473b6be830b5501 Jul 29 11:39:46.416477 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-User-Name: admin Jul 29 11:39:46.416477 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: method: > Jul 29 11:39:46.416477 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: exception: Flavor 42 could not be found. Jul 29 11:39:46.416477 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: action_args: {'id': '42'} Jul 29 11:39:46.416477 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:39:46.416477 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:39:46.417445 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Jul 29 11:39:46.418557 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-d43176f6-3c14-4389-9cf7-f87491a7a26c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115057) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:39:46.419527 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-d43176f6-3c14-4389-9cf7-f87491a7a26c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015328 Jul 29 11:39:46.419527 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Fri Jul 29 11:39:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:47.391855 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-7b8dc424-220c-4a05-8b24-9a83071907ba admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:47.392903 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-7b8dc424-220c-4a05-8b24-9a83071907ba admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001716 Jul 29 11:39:47.393299 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Jul 29 11:39:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:39:47.915847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-460ef6e1-791a-42c5-9f9c-6f6e9f072360 admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:47.921881 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.wsgi [None req-460ef6e1-791a-42c5-9f9c-6f6e9f072360 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-460ef6e1-791a-42c5-9f9c-6f6e9f072360 admin admin] Request method failure captured: Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Accept: application/json Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Accept-Encoding: gzip, deflate Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Connection: keep-alive Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Content-Length: 0 Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Host: 10.222.0.60 Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Openstack-Api-Version: compute 2.90 Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Openstack-System-Scope: None Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: User-Agent: python-novaclient Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Auth-Token: gAAAAABi48cDyYcYKhsGAwWFuBHymQmI9hc7LJxepxbOpwNwKdr4saY61DsLE9xjkxjfnEiEPZNyfid2kpM5Kr0pCHilgEg9gLryUe1LHJf2irMqegjntRpX-bfqXZ3rM4tDyToMk9pdrP4hpJAB0VyIuUAhNJ1jQesQI9fL3qcdYFMA386MpxE Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Domain-Id: None Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Domain-Name: None Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Identity-Status: Confirmed Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Is-Admin-Project: True Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Project-Domain-Id: default Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Project-Domain-Name: Default Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Project-Id: b9c00e3cb2134915b18b1a5e5538e94a Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Project-Name: admin Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Role: reader,member,admin Jul 29 11:39:47.923422 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Roles: reader,member,admin Jul 29 11:39:47.924938 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b9c00e3cb2134915b18b1a5e5538e94a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:39:47.924938 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Tenant: admin Jul 29 11:39:47.924938 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Tenant-Id: b9c00e3cb2134915b18b1a5e5538e94a Jul 29 11:39:47.924938 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Tenant-Name: admin Jul 29 11:39:47.924938 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-User: admin Jul 29 11:39:47.924938 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-User-Domain-Id: default Jul 29 11:39:47.924938 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-User-Domain-Name: Default Jul 29 11:39:47.924938 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-User-Id: 0086f32849da40e39473b6be830b5501 Jul 29 11:39:47.924938 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-User-Name: admin Jul 29 11:39:47.924938 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: method: > Jul 29 11:39:47.924938 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: exception: Flavor 84 could not be found. Jul 29 11:39:47.924938 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: action_args: {'id': '84'} Jul 29 11:39:47.924938 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:39:47.924938 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:39:47.926000 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Jul 29 11:39:47.927398 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-460ef6e1-791a-42c5-9f9c-6f6e9f072360 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115057) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:39:47.928594 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-460ef6e1-791a-42c5-9f9c-6f6e9f072360 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.392073 Jul 29 11:39:47.928594 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Fri Jul 29 11:39:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:47.934387 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-baa44f88-aa0e-46ec-b872-760db2f6ee7f admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:47.949802 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-baa44f88-aa0e-46ec-b872-760db2f6ee7f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018914 Jul 29 11:39:47.950321 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Jul 29 11:39:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:39:47.959648 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-200aa554-ebef-43fd-877e-80c5ee84af8f admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:47.976060 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-200aa554-ebef-43fd-877e-80c5ee84af8f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019894 Jul 29 11:39:47.976597 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Jul 29 11:39:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:39:47.986530 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-d72d896a-f8ec-4f9a-b8ee-5a97cb24f19b admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:47.992607 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.wsgi [None req-d72d896a-f8ec-4f9a-b8ee-5a97cb24f19b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-d72d896a-f8ec-4f9a-b8ee-5a97cb24f19b admin admin] Request method failure captured: Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Accept: application/json Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Accept-Encoding: gzip, deflate Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Connection: keep-alive Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Content-Length: 0 Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Host: 10.222.0.60 Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Openstack-Api-Version: compute 2.90 Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Openstack-System-Scope: None Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: User-Agent: python-novaclient Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Auth-Token: gAAAAABi48cDyYcYKhsGAwWFuBHymQmI9hc7LJxepxbOpwNwKdr4saY61DsLE9xjkxjfnEiEPZNyfid2kpM5Kr0pCHilgEg9gLryUe1LHJf2irMqegjntRpX-bfqXZ3rM4tDyToMk9pdrP4hpJAB0VyIuUAhNJ1jQesQI9fL3qcdYFMA386MpxE Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Domain-Id: None Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Domain-Name: None Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Identity-Status: Confirmed Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Is-Admin-Project: True Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Project-Domain-Id: default Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Project-Domain-Name: Default Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Project-Id: b9c00e3cb2134915b18b1a5e5538e94a Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Project-Name: admin Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Role: reader,member,admin Jul 29 11:39:47.994233 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Roles: reader,member,admin Jul 29 11:39:47.995478 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b9c00e3cb2134915b18b1a5e5538e94a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:39:47.995478 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Tenant: admin Jul 29 11:39:47.995478 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Tenant-Id: b9c00e3cb2134915b18b1a5e5538e94a Jul 29 11:39:47.995478 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Tenant-Name: admin Jul 29 11:39:47.995478 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-User: admin Jul 29 11:39:47.995478 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-User-Domain-Id: default Jul 29 11:39:47.995478 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-User-Domain-Name: Default Jul 29 11:39:47.995478 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-User-Id: 0086f32849da40e39473b6be830b5501 Jul 29 11:39:47.995478 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-User-Name: admin Jul 29 11:39:47.995478 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: method: > Jul 29 11:39:47.995478 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: exception: Flavor 84 could not be found. Jul 29 11:39:47.995478 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: action_args: {'id': '84'} Jul 29 11:39:47.995478 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:39:47.995478 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:39:47.996246 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Jul 29 11:39:47.997587 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-d72d896a-f8ec-4f9a-b8ee-5a97cb24f19b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:39:47.998557 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-d72d896a-f8ec-4f9a-b8ee-5a97cb24f19b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013443 Jul 29 11:39:47.998557 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Fri Jul 29 11:39:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:48.969673 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-200aa554-ebef-43fd-877e-80c5ee84af8f admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:48.970673 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-200aa554-ebef-43fd-877e-80c5ee84af8f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 29 11:39:48.971060 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Jul 29 11:39:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:39:49.490121 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-99f4c5b8-5488-44fb-861f-c91bc8dccad5 admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:49.495864 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.wsgi [None req-99f4c5b8-5488-44fb-861f-c91bc8dccad5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-99f4c5b8-5488-44fb-861f-c91bc8dccad5 admin admin] Request method failure captured: Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Accept: application/json Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Accept-Encoding: gzip, deflate Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Connection: keep-alive Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Content-Length: 0 Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Host: 10.222.0.60 Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Openstack-Api-Version: compute 2.90 Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Openstack-System-Scope: None Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: User-Agent: python-novaclient Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Auth-Token: gAAAAABi48cE3sKtwufZiK3v151b_NMFS4wju2_2hEg3-xsHXXwnRIYFVuuUYmK9A1eslCkWj0nErwIF6l1sT4D5tLKgIPQkx2lEjtJef9D8bYiuQTtlztj3FF7oiWVmAAnqSMUgTyP8ET052dKdopsTi5sITI6YfzSDYe_ieMZqseGO77Vuncs Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Domain-Id: None Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Domain-Name: None Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Identity-Status: Confirmed Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Is-Admin-Project: True Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Project-Domain-Id: default Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Project-Domain-Name: Default Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Project-Id: b9c00e3cb2134915b18b1a5e5538e94a Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Project-Name: admin Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Role: reader,member,admin Jul 29 11:39:49.497339 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Roles: reader,member,admin Jul 29 11:39:49.498844 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b9c00e3cb2134915b18b1a5e5538e94a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:39:49.498844 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Tenant: admin Jul 29 11:39:49.498844 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Tenant-Id: b9c00e3cb2134915b18b1a5e5538e94a Jul 29 11:39:49.498844 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-Tenant-Name: admin Jul 29 11:39:49.498844 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-User: admin Jul 29 11:39:49.498844 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-User-Domain-Id: default Jul 29 11:39:49.498844 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-User-Domain-Name: Default Jul 29 11:39:49.498844 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-User-Id: 0086f32849da40e39473b6be830b5501 Jul 29 11:39:49.498844 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: X-User-Name: admin Jul 29 11:39:49.498844 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: method: > Jul 29 11:39:49.498844 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: exception: Flavor 451 could not be found. Jul 29 11:39:49.498844 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: action_args: {'id': '451'} Jul 29 11:39:49.498844 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:39:49.498844 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:39:49.500014 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: ERROR nova.api.openstack.wsgi Jul 29 11:39:49.501312 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-99f4c5b8-5488-44fb-861f-c91bc8dccad5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:39:49.502577 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-99f4c5b8-5488-44fb-861f-c91bc8dccad5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.390009 Jul 29 11:39:49.502577 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Jul 29 11:39:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 11:39:49.508645 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-42a2b7f3-9308-4f50-af65-77fc0e894216 admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:49.524420 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-42a2b7f3-9308-4f50-af65-77fc0e894216 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019365 Jul 29 11:39:49.524947 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Jul 29 11:39:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:39:49.534919 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-5a9eddb7-6f2a-4e84-9429-360ae0e51721 admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:49.549597 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-5a9eddb7-6f2a-4e84-9429-360ae0e51721 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018887 Jul 29 11:39:49.550139 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Jul 29 11:39:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:39:49.559019 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-68fd4a39-6400-41f6-8222-fa48d888fd9e admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:49.564320 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.wsgi [None req-68fd4a39-6400-41f6-8222-fa48d888fd9e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-68fd4a39-6400-41f6-8222-fa48d888fd9e admin admin] Request method failure captured: Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Accept: application/json Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Accept-Encoding: gzip, deflate Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Connection: keep-alive Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Content-Length: 0 Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Host: 10.222.0.60 Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Openstack-Api-Version: compute 2.90 Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Openstack-System-Scope: None Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: User-Agent: python-novaclient Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Auth-Token: gAAAAABi48cE3sKtwufZiK3v151b_NMFS4wju2_2hEg3-xsHXXwnRIYFVuuUYmK9A1eslCkWj0nErwIF6l1sT4D5tLKgIPQkx2lEjtJef9D8bYiuQTtlztj3FF7oiWVmAAnqSMUgTyP8ET052dKdopsTi5sITI6YfzSDYe_ieMZqseGO77Vuncs Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Domain-Id: None Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Domain-Name: None Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Identity-Status: Confirmed Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Is-Admin-Project: True Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Project-Domain-Id: default Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Project-Domain-Name: Default Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Project-Id: b9c00e3cb2134915b18b1a5e5538e94a Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Project-Name: admin Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Role: reader,member,admin Jul 29 11:39:49.565847 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Roles: reader,member,admin Jul 29 11:39:49.567524 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b9c00e3cb2134915b18b1a5e5538e94a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b9c00e3cb2134915b18b1a5e5538e94a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:39:49.567524 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Tenant: admin Jul 29 11:39:49.567524 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Tenant-Id: b9c00e3cb2134915b18b1a5e5538e94a Jul 29 11:39:49.567524 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-Tenant-Name: admin Jul 29 11:39:49.567524 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-User: admin Jul 29 11:39:49.567524 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-User-Domain-Id: default Jul 29 11:39:49.567524 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-User-Domain-Name: Default Jul 29 11:39:49.567524 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-User-Id: 0086f32849da40e39473b6be830b5501 Jul 29 11:39:49.567524 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: X-User-Name: admin Jul 29 11:39:49.567524 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: method: > Jul 29 11:39:49.567524 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: exception: Flavor 451 could not be found. Jul 29 11:39:49.567524 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: action_args: {'id': '451'} Jul 29 11:39:49.567524 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:39:49.567524 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:39:49.568473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: ERROR nova.api.openstack.wsgi Jul 29 11:39:49.569547 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-68fd4a39-6400-41f6-8222-fa48d888fd9e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115057) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:39:49.570541 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-68fd4a39-6400-41f6-8222-fa48d888fd9e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011647 Jul 29 11:39:49.570541 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Jul 29 11:39:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 29 11:39:50.532273 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-5a9eddb7-6f2a-4e84-9429-360ae0e51721 admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:50.533302 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-5a9eddb7-6f2a-4e84-9429-360ae0e51721 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jul 29 11:39:50.533735 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Jul 29 11:39:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:39:51.054469 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-3cb47171-7277-4dd2-9c27-391767e0387d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:51.073068 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-3cb47171-7277-4dd2-9c27-391767e0387d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.402036 Jul 29 11:39:51.073654 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Fri Jul 29 11:39:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 11:39:52.057213 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-5a9eddb7-6f2a-4e84-9429-360ae0e51721 admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:52.058252 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-5a9eddb7-6f2a-4e84-9429-360ae0e51721 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 29 11:39:52.058649 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Jul 29 11:39:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:39:52.582164 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-6da8e20f-6968-4abb-8789-124be389a0b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:52.600108 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-6da8e20f-6968-4abb-8789-124be389a0b7 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.401768 Jul 29 11:39:52.600664 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Fri Jul 29 11:39:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 11:39:53.569668 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-5a9eddb7-6f2a-4e84-9429-360ae0e51721 admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:53.570695 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-5a9eddb7-6f2a-4e84-9429-360ae0e51721 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 29 11:39:53.571100 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Jul 29 11:39:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:39:54.219433 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-241d4551-aaa5-4b6d-ae05-801f53ead938 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:54.238309 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-241d4551-aaa5-4b6d-ae05-801f53ead938 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.530424 Jul 29 11:39:54.238846 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Fri Jul 29 11:39:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 11:39:55.208690 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-5a9eddb7-6f2a-4e84-9429-360ae0e51721 admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:55.209760 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-5a9eddb7-6f2a-4e84-9429-360ae0e51721 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 29 11:39:55.210169 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Jul 29 11:39:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:39:55.731309 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-8ce9725a-7b38-47bd-ab64-15a1a3e9f6b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:39:55.750312 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-8ce9725a-7b38-47bd-ab64-15a1a3e9f6b1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.398504 Jul 29 11:39:55.750863 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Fri Jul 29 11:39:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 11:39:56.834757 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-5a9eddb7-6f2a-4e84-9429-360ae0e51721 admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:56.835782 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-5a9eddb7-6f2a-4e84-9429-360ae0e51721 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 29 11:39:56.836181 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Jul 29 11:39:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:39:57.361903 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-ec92bd05-d6bb-434a-9d3a-114ea19d306d admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:39:57.382601 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-ec92bd05-d6bb-434a-9d3a-114ea19d306d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.407940 Jul 29 11:39:57.383075 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Fri Jul 29 11:39:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:40:48.872447 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-5a9eddb7-6f2a-4e84-9429-360ae0e51721 admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:40:48.873548 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-5a9eddb7-6f2a-4e84-9429-360ae0e51721 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002156 Jul 29 11:40:48.873952 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 930 bytes} [Fri Jul 29 11:40:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:40:48.884473 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG dbcounter [-] [115057] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:49.276537 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-75fa21e2-c216-4a40-a5bb-7e26af86c7a3 admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:40:49.297452 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-75fa21e2-c216-4a40-a5bb-7e26af86c7a3 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.417465 Jul 29 11:40:49.297990 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1291 bytes} [Fri Jul 29 11:40:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:40:49.320460 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-12bd998b-8042-49c4-9627-b528c9d42aa0 admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:40:49.323912 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG dbcounter [-] [115056] Writing DB stats nova_api:SELECT=14 {{(pid=115056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:40:49.330369 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-12bd998b-8042-49c4-9627-b528c9d42aa0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013552 Jul 29 11:40:49.330896 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1282 bytes} [Fri Jul 29 11:40:49 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:40:49.343150 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-11938445-834a-425f-914a-5098f4916433 admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:40:49.350861 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-11938445-834a-425f-914a-5098f4916433 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011969 Jul 29 11:40:49.351388 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1285 bytes} [Fri Jul 29 11:40:49 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:40:49.362730 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-1aa9a359-6c4b-4684-b6de-de4a1991c7ae admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:40:49.370172 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-1aa9a359-6c4b-4684-b6de-de4a1991c7ae admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010950 Jul 29 11:40:49.370672 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1285 bytes} [Fri Jul 29 11:40:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:40:49.381776 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-ea0045bf-a31c-4985-92c1-44d357405edc admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:40:49.390172 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-ea0045bf-a31c-4985-92c1-44d357405edc admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011670 Jul 29 11:40:49.390693 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1282 bytes} [Fri Jul 29 11:40:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:44:18.508646 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-1aa9a359-6c4b-4684-b6de-de4a1991c7ae admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:44:18.509726 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-1aa9a359-6c4b-4684-b6de-de4a1991c7ae admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 29 11:44:18.510124 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Jul 29 11:44:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:44:18.651364 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG dbcounter [-] [115057] Writing DB stats nova_api:SELECT=6 {{(pid=115057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:44:18.812462 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-6de79024-7f67-4ea7-b068-3087686fd047 admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:44:18.815351 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:44:18.815351 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: warnings.warn(msg) Jul 29 11:44:18.816668 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-6de79024-7f67-4ea7-b068-3087686fd047 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:44:18.817105 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-6de79024-7f67-4ea7-b068-3087686fd047 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:44:18.817916 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-6de79024-7f67-4ea7-b068-3087686fd047 admin admin] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:44:18.818344 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-6de79024-7f67-4ea7-b068-3087686fd047 admin admin] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:44:18.853404 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-6de79024-7f67-4ea7-b068-3087686fd047 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.203501 Jul 29 11:44:18.854021 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Jul 29 11:44:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 11:44:19.689570 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-1aa9a359-6c4b-4684-b6de-de4a1991c7ae admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:44:19.690567 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-1aa9a359-6c4b-4684-b6de-de4a1991c7ae admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 29 11:44:19.690958 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Jul 29 11:44:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:44:19.880793 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-f7c067d1-768d-47d2-92df-3f38bb9c746e admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:44:19.883282 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:44:19.883282 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: warnings.warn(msg) Jul 29 11:44:19.884481 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-f7c067d1-768d-47d2-92df-3f38bb9c746e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:44:19.884931 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-f7c067d1-768d-47d2-92df-3f38bb9c746e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:44:19.885772 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-f7c067d1-768d-47d2-92df-3f38bb9c746e admin admin] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:44:19.886204 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-f7c067d1-768d-47d2-92df-3f38bb9c746e admin admin] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:44:19.906268 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-f7c067d1-768d-47d2-92df-3f38bb9c746e admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077253 Jul 29 11:44:19.906763 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Jul 29 11:44:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 11:44:31.143965 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-1aa9a359-6c4b-4684-b6de-de4a1991c7ae admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:44:31.145052 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-1aa9a359-6c4b-4684-b6de-de4a1991c7ae admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 29 11:44:31.145538 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Jul 29 11:44:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:44:31.285573 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG dbcounter [-] [115057] Writing DB stats nova_cell0:SELECT=4 {{(pid=115057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:44:31.286291 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG dbcounter [-] [115057] Writing DB stats nova_cell1:SELECT=4 {{(pid=115057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:44:31.286899 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG dbcounter [-] [115057] Writing DB stats nova_api:SELECT=8 {{(pid=115057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:44:31.335885 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-f6534102-a4b3-4c7d-8178-460defe272a1 admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:44:31.338323 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:44:31.338323 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: warnings.warn(msg) Jul 29 11:44:31.339554 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-f6534102-a4b3-4c7d-8178-460defe272a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:44:31.340001 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-f6534102-a4b3-4c7d-8178-460defe272a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:44:31.340781 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-f6534102-a4b3-4c7d-8178-460defe272a1 admin admin] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:44:31.341219 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-f6534102-a4b3-4c7d-8178-460defe272a1 admin admin] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:44:31.367402 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-f6534102-a4b3-4c7d-8178-460defe272a1 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086818 Jul 29 11:44:31.367895 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 38/74] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Jul 29 11:44:31 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:44:32.199206 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: DEBUG nova.api.openstack.wsgi [None req-1aa9a359-6c4b-4684-b6de-de4a1991c7ae admin admin] Calling method '>' {{(pid=115056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:44:32.200255 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: INFO nova.api.openstack.requestlog [None req-1aa9a359-6c4b-4684-b6de-de4a1991c7ae admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 29 11:44:32.200652 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: [pid: 115056|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Jul 29 11:44:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:44:32.389332 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG nova.api.openstack.wsgi [None req-4316012f-9d61-4189-bda4-fbe658c8f936 admin admin] Calling method '>' {{(pid=115057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:44:32.391728 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 11:44:32.391728 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: warnings.warn(msg) Jul 29 11:44:32.393782 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-4316012f-9d61-4189-bda4-fbe658c8f936 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:44:32.394259 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-4316012f-9d61-4189-bda4-fbe658c8f936 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:44:32.395056 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-4316012f-9d61-4189-bda4-fbe658c8f936 admin admin] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:44:32.395491 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: DEBUG oslo_concurrency.lockutils [None req-4316012f-9d61-4189-bda4-fbe658c8f936 admin admin] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:44:32.417646 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: INFO nova.api.openstack.requestlog [None req-4316012f-9d61-4189-bda4-fbe658c8f936 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079396 Jul 29 11:44:32.418140 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: [pid: 115057|app: 0|req: 39/76] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Jul 29 11:44:32 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:45:30.111301 dv-cinder-837542-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 29 11:45:30.112369 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: Fri Jul 29 11:45:30 2022 - graceful shutdown triggered... Jul 29 11:45:30.112825 dv-cinder-837542-7-iscsi devstack@n-api.service[115056]: Gracefully killing worker 1 (pid: 115056)... Jul 29 11:45:30.113194 dv-cinder-837542-7-iscsi devstack@n-api.service[115057]: Gracefully killing worker 2 (pid: 115057)... Jul 29 11:45:31.112966 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: worker 1 buried after 1 seconds Jul 29 11:45:31.112966 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: worker 2 buried after 1 seconds Jul 29 11:45:31.112966 dv-cinder-837542-7-iscsi devstack@n-api.service[115055]: goodbye to uWSGI. Jul 29 11:45:31.114494 dv-cinder-837542-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 29 11:45:31.115060 dv-cinder-837542-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 29 11:45:31.117977 dv-cinder-837542-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 29 11:45:31.128296 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 29 11:45:31.130951 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 11:45:31 2022] *** Jul 29 11:45:31.131108 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 11:45:31.131242 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 11:45:31.131372 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: nodename: dv-cinder-837542-7-iscsi Jul 29 11:45:31.131492 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: machine: x86_64 Jul 29 11:45:31.131611 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: clock source: unix Jul 29 11:45:31.131724 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: pcre jit disabled Jul 29 11:45:31.131834 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: detected number of CPU cores: 4 Jul 29 11:45:31.131944 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: current working directory: / Jul 29 11:45:31.132055 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: detected binary path: /usr/bin/uwsgi-core Jul 29 11:45:31.132171 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: your processes number limit is 47680 Jul 29 11:45:31.132297 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: your memory page size is 4096 bytes Jul 29 11:45:31.132417 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: detected max file descriptor number: 2048 Jul 29 11:45:31.132530 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: lock engine: pthread robust mutexes Jul 29 11:45:31.132810 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: thunder lock: enabled Jul 29 11:45:31.133119 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 29 11:45:31.133329 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 11:45:31.179995 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: Python main interpreter initialized at 0x55dc44bbe9c0 Jul 29 11:45:31.179995 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: python threads support enabled Jul 29 11:45:31.179995 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: your server socket listen backlog is limited to 100 connections Jul 29 11:45:31.179995 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: your mercy for graceful operations on workers is 90 seconds Jul 29 11:45:31.180440 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 11:45:31.180440 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: *** Operational MODE: preforking *** Jul 29 11:45:31.180737 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: *** uWSGI is running in multiple interpreter mode *** Jul 29 11:45:31.180737 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: spawned uWSGI master process (pid: 129568) Jul 29 11:45:31.180960 dv-cinder-837542-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 29 11:45:31.181746 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: spawned uWSGI worker 1 (pid: 129584, cores: 1) Jul 29 11:45:31.182112 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: spawned uWSGI worker 2 (pid: 129585, cores: 1) Jul 29 11:45:31.182278 dv-cinder-837542-7-iscsi devstack@n-api.service[129568]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 11:45:31.846395 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 11:45:31.853593 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 11:45:33.011144 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 11:45:33.011144 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: from cryptography.utils import int_from_bytes Jul 29 11:45:33.011770 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 11:45:33.011770 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: from cryptography.utils import int_from_bytes Jul 29 11:45:33.012163 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 11:45:33.012163 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: from cryptography.utils import int_from_bytes Jul 29 11:45:33.012289 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 11:45:33.012289 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: from cryptography.utils import int_from_bytes Jul 29 11:45:35.424427 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 11:45:35.425004 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 11:45:35.425293 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 11:45:35.425663 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 11:45:35.425919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 11:45:35.426307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.426630 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.426950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.427280 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.427593 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.427901 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.428233 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.428539 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.428864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.429123 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.429449 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.429771 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837542-7-iscsi {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.430096 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.430562 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.430877 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.431203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.431507 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.431826 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.432131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.432636 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.434152 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.434152 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.434152 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.434456 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.434699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.434988 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.435311 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.435621 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.435930 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.436384 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.436932 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837542-7-iscsi {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.437452 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.437773 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.438088 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.438287 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 11:45:35.438733 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.438812 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 11:45:35.438912 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.439140 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 11:45:35.439365 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.439608 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 11:45:35.439836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.440057 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 11:45:35.440280 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.440280 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.440706 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.440706 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.441101 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.441298 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.441519 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.441519 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.441875 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.442037 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.442190 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.442346 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.442491 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.442683 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.442829 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.443030 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.443194 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.443340 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.443496 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.443662 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.443820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.444017 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.444183 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.444336 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.444488 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837542-7-iscsi {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.444634 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.444793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.444946 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.444946 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.445238 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.445450 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.445643 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.445811 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.445981 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.446126 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.446281 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.446433 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.446624 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.446818 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.446981 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.447126 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.447126 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.447405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.447590 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.447738 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.447909 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.448056 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.448231 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.448376 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.449221 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.449379 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.449608 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.449763 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.449916 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.450090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.450248 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.450436 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.450586 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.450731 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.450874 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.451266 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.451445 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.451600 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.452277 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.452429 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837542-7-iscsi {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.452587 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.452587 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.453068 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.453219 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.453363 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.453363 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.453676 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.453676 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.453969 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.454121 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.454273 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.454417 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.454581 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.454738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.454884 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.455045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.455191 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.455350 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.455496 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.455646 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.455799 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.455946 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.456090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.456243 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.456400 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.456553 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.456709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.456865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.457018 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.457175 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.457332 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.457500 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.457649 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.457803 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.457959 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.458122 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.458268 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.458438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.458624 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.459523 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.459708 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.459857 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.460009 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.460156 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.460300 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.460460 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.460620 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.460774 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.460774 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.461067 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.461067 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.461353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.461657 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.461814 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.461971 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.462118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.462268 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.462475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.462622 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.462768 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.462921 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.463068 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.463261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.463420 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.463578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.463724 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.463876 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.464023 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.464166 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.464324 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.464479 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.464631 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.464792 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.464938 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.465082 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.465236 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.465389 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.465662 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.465834 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.465982 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.466127 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.466277 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.466277 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.466575 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.466728 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.466881 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.467027 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.467191 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.468773 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.469546 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.469917 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.470084 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.470245 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.470399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.470546 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.470709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.470864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.471011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.471164 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.471318 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.471472 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.471628 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.471782 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.471949 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.472098 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.472253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.472463 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.472620 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.472766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.472910 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.473054 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.473054 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.473798 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.473798 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.474092 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.474257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.474412 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.474558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.474716 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.474716 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.475003 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.475154 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.475308 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.475454 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.475608 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.475759 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.475912 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.476057 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.476212 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.476372 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.476529 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.476529 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.476817 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.476963 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.477107 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.477266 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.477502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.477661 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.477819 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.477965 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.478115 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.478288 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.478444 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.478596 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.478756 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.478916 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.479599 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.479773 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.480113 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.480275 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.480430 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.480578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.480739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.480905 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.481059 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.481205 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.481350 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.481535 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.481693 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.481838 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.481982 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.482161 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.482629 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.482933 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.483866 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.484089 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.484295 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.484489 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.484673 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.484862 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.485043 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.485231 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.485475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.485764 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.485951 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.486131 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.486319 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.486513 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.486709 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.486916 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.487106 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.487296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.487486 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.487675 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.487872 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.488062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.488252 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.488433 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.488620 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.488802 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.488802 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.489813 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.490066 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.490591 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.490841 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.491119 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.491661 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.491819 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.491976 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.492131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.492523 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.492728 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.492880 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.493044 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.493212 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.493360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.493542 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.493698 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.493845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.494000 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.494158 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.494591 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.494739 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 11:45:35.494884 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.495040 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.495188 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.495188 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.495493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.495648 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.495809 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.495966 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.496113 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.496259 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.496403 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.496549 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.496700 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.496858 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.497005 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.497163 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.497633 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.497793 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.497939 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.498094 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.498094 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.498379 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.498525 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.498676 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.498676 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.498975 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.498975 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.499251 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.499251 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.501012 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.501012 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.503736 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.503900 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.504073 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.504367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.504540 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.504704 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.504854 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.505009 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.505168 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.505316 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.505538 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.505722 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.505871 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.506016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.506169 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.506321 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.506492 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.506640 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.506794 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.506941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.506941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.507236 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.507394 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.507394 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.507697 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.507856 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.507856 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.508131 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.508845 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.509021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.509179 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.509179 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.509490 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.509733 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.509733 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.510042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.510237 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.510237 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.511150 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.511307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.511307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.511593 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.511740 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.511740 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.512024 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.512188 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.512188 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.512722 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.512868 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.512868 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.513164 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.513321 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.513321 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.513679 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.513833 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.513833 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.513833 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.514804 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.514965 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.515113 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.515265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.515265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.515571 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.515725 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.515725 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.516008 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.516162 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.516162 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.516476 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.517199 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.517199 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.517533 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.517682 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.517682 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.517976 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.518134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.518134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.518409 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.518554 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.518554 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.518859 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.519017 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.519017 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.519310 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.519456 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.519456 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.519764 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.519985 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.520154 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.520310 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.520310 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.520310 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.521392 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.521573 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.521728 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.521875 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.521875 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.522246 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.522406 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.522406 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.522710 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.522857 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.522857 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.523144 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.523292 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.523292 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.523576 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.523729 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.523894 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.524059 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.524059 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.524346 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.524497 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.524665 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.524828 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.524988 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.525148 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.525308 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.525562 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.525734 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.525898 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.526050 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.526210 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.526363 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.526513 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.526675 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.526848 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.527008 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.527168 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.527320 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.527472 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.527631 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.527795 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.527795 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.528082 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.528082 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.528385 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.528552 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.528552 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.528872 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.528872 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.529159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.529309 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.529491 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.529660 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.529814 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.530609 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.531385 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.531553 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.531717 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.531871 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.532022 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.532184 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.532337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.532489 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.532654 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.532809 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.532967 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.533119 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.533277 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.533547 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.533721 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.533875 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.534035 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.534198 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.534358 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.534520 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.534673 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.534830 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.534984 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.535142 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.535294 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.535459 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.535621 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.535779 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.535939 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.536101 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.536263 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.536430 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.536583 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.536734 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.536884 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.537034 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.537195 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.537347 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.537522 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.537685 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.538046 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.538214 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.538379 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.538557 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.538722 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.538875 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.539026 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.539026 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.539343 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.539496 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.539648 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.539805 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.539965 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.540138 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.540374 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.540543 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.540708 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.540879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.541662 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.541839 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.542003 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.542155 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.542315 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.542470 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.542621 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.542786 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.542939 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.543097 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.543261 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.543414 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.543565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.543743 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.543906 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.544066 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.544225 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.544385 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.544546 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.544712 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.544881 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.545044 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.545204 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.545376 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.545769 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.545930 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.546089 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.546278 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.546445 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.546600 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.546766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.546927 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.547081 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.547232 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.547391 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.547854 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.548036 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.548204 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.548365 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.548525 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.548689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.548842 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.548842 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.549144 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.549303 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.549486 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.549645 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.549813 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.549965 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.550127 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.550278 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.550555 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.550725 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.550894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.551067 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.551887 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.552046 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.552206 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.552359 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.552521 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.552674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.552849 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.553001 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.553167 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.553319 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.553508 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.553667 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.553827 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.554064 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.554220 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.554379 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.554539 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.554698 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.554857 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.555039 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.555203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.555356 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.555508 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.555658 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.555809 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.555970 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.556130 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.556282 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.556433 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.556583 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.556741 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.556908 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.557072 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.557230 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.557382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.557561 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.557730 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.557969 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.558129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.558282 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.558440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.558596 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.558762 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.558927 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.559098 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.559277 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.559432 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.559583 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.559744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.559898 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.560197 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.560357 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.560537 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.560782 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.560782 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.561113 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.561273 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.561803 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.562169 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.562349 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.562505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.562656 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.562815 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.562975 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.563128 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.563289 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.563454 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.563606 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.563765 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.563925 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.564115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.564282 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.565018 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.565194 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.565349 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.565542 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.565706 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.565858 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.566018 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.566185 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.566378 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.566552 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.566712 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.566865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.567025 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.567195 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.567349 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.567503 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.567654 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.567813 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.567996 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.568237 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.568412 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.568568 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.568732 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.568884 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.569049 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.569202 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.569360 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.569633 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.569796 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.569949 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.570112 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.570272 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.570425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.570574 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.570745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.570997 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.571167 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.571329 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.571483 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.572018 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.572381 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.572553 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.572716 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.572879 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.573032 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.573184 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.573346 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.573541 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.573541 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.573874 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.574035 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.574188 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.574188 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.574484 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.574645 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.574798 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.574950 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.575100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.575100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.575397 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.575570 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.575723 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.575877 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.576034 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.576199 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.576361 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.576521 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.576680 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.577358 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.577585 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.578070 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.578446 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.578617 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.578617 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.578927 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.579248 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.579423 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.579593 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.579698 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.579803 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.579898 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.579994 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.580070 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.580163 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.580258 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.580390 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.580487 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.580574 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.580667 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.580767 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.580860 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.580981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.581079 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.581079 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.581247 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.581339 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.581442 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.581548 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.581636 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.581737 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.581737 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.582194 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.582311 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.582595 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.582697 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.582784 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.582888 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.582986 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.583089 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.583177 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.583269 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.583362 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.583464 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.583559 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.583658 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.583752 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.583845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.583939 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.584025 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.584109 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.584205 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.584299 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.584391 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.584478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.584570 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.584665 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.584760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.584853 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.584940 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.585024 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.585116 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.585116 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.585353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.585507 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.585597 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.585681 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.585765 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.585864 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.585951 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.586036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.586128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.586221 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.586306 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.586404 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.586498 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.586600 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.586694 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.586787 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.586887 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.586973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.587056 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.587140 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.587224 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.587315 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.587415 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.587510 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.587597 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.587689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.587775 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.587866 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.587984 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.588061 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.588141 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.588220 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.588305 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.588414 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.588512 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.588608 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.588738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.588840 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.588927 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.589022 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.589116 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.589209 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.589315 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.589406 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.589499 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.589659 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.589736 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.589815 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.589888 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.589959 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.590076 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.590171 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.590253 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.590333 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.590406 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.590503 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.590599 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.590695 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.590789 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.590881 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.590881 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.591044 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.591137 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.591220 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.591306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.591390 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.591481 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.591567 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.591665 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.591751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.591841 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.591942 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.592250 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.592429 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.593138 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.593672 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.593766 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.593852 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.593936 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.593936 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.593936 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.594169 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.594250 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.594332 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.594405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.594487 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.594568 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.594648 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.594727 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.594800 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.594877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.594964 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.595039 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.595111 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.595189 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.595261 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.595340 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.595435 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.595522 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.595614 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.595699 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.595791 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.595885 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.595980 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.596074 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.596159 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.596243 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.596243 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.596410 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.596503 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.596589 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.596673 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.596758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.596842 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.596935 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.597028 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.597121 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.597214 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.597308 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.597400 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.597518 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.597594 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.597665 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.597749 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.597841 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.597927 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.598024 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.598112 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.598196 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.598280 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.598370 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.598470 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.598563 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.598649 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.598732 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.598813 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.598905 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.599005 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.599098 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.599183 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.599268 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.599352 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.599436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.599529 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.599623 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.599709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.599800 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.599885 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.599968 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.600065 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.600151 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.600243 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.600243 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.600404 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.600498 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.600592 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.600678 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.600768 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.600861 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.600946 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.601040 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.601126 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.601210 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.601294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.601381 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.601486 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.601576 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.601657 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.601750 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.601843 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.601917 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.601995 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.602081 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.602366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.602472 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.602557 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.602638 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.602725 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.602806 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.602880 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.602951 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.603028 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.603101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.603185 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.603259 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.603336 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.603431 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.603509 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.603588 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.603671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.603745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.603816 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.603895 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.603974 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.603974 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.604375 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.604460 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.604540 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.604614 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.604695 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.604695 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.604825 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.604896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.604973 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.605062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.605146 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.605146 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.605670 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.605755 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.605829 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.605829 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.605972 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.605972 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.606126 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.606207 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.606286 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.606372 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.606446 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.606517 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.606588 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.606658 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.606736 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.606736 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.606736 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.606736 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.606992 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.607064 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.607135 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.607216 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.607290 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.607361 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.607439 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.607518 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.607597 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.607679 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.607759 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.607839 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.607919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.608208 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.608319 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.608410 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.608496 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.608496 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.608496 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.608496 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.608496 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.608857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.608946 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.609020 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.609099 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.609099 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.609242 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.609316 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.609388 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.609624 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.609700 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.609772 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.609863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.609946 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.610020 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.610092 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.610164 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.610250 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.610330 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.610404 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.610484 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.610571 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.610674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.610900 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.611003 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.611220 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.611327 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.611546 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.611652 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.611876 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.611971 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.612193 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.612309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.612564 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.612652 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.612824 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.612929 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.613143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.613246 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.613485 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.613627 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.613804 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.613958 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.614120 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.614285 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.614443 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.614598 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.614758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.614922 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.615068 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.615236 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.615386 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.615548 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.615703 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.615881 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.616024 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.616177 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.616487 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.616596 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.616815 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.616910 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.617126 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.617227 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.617507 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.617607 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.617784 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.617880 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.618099 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.618199 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.618412 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.618509 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.618718 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.618819 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.619047 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.619218 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.619376 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.619520 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.619669 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.619824 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.619968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.620123 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.620268 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.620423 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.620574 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.620716 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.620887 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.621043 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.621213 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.621365 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.621550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.621659 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.621859 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.621968 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.622167 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.622261 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.622489 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.622593 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.622820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.622928 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.623127 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.623229 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.623441 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.623534 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.623788 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.623887 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.624114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.624223 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.624424 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.624516 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.624739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.624836 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.625055 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.625149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.625371 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.625568 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.625711 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.625798 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.626023 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.626125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.626340 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.626488 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.626661 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.626774 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.626978 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.627089 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.627287 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.627399 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.627600 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.627693 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.627907 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.628003 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.628218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.628320 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.628526 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.628617 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.628834 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.629051 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.629173 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.629372 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.629483 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.629750 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.629852 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.630082 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.630189 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.630400 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.630491 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.630708 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.630806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.631016 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.631118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.631322 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.631414 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.631644 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.631742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.631953 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.632063 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.632273 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.632372 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.632590 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.632760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.632952 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.633070 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.633226 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.633329 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.633563 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.633661 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.633876 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.633974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.634193 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.634286 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.634504 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.634606 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.634819 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.635046 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.635142 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.635401 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.635496 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.635723 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.635828 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.636044 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.636153 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.636355 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.636458 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.636672 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.636783 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.636982 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.637087 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.637295 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.637666 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.637883 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.638139 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.638241 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.638473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.638567 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.638793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.638898 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.639100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.639735 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.639943 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.640081 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.640258 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.640435 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.640576 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.640760 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.640890 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.641071 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.641208 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.641388 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.641546 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.641784 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.641894 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.642125 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.642318 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.642441 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.642547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.642755 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.642894 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.643088 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.643202 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.643377 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.643483 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.643688 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.643788 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.643998 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.644115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.644308 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.644416 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.644617 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.644744 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.644936 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.645045 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.645244 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.645345 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.645581 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.645694 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.645890 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.645983 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.646204 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.646297 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.646511 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.646618 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.646823 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.646920 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.647139 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.647235 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.647457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.647552 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.647777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.647860 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.648132 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.648241 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.648400 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.648507 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.648718 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.648816 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.649047 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.649137 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.649385 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.649511 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.649735 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.649835 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.650052 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.650144 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.650368 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.650461 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.650687 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.650930 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.651234 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.651342 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.651535 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.651632 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.651871 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.651969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.652200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.652299 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.652529 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.652621 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.652840 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.652945 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.653152 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.653518 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.653518 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.653709 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.653800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.653893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.654102 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.654206 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.654417 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.654512 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.654732 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.654873 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.655633 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.655822 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.656022 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.656168 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.656388 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.656490 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.656703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.656798 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.657029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.657124 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.657348 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.657500 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.657707 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.657945 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.658055 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.658304 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.658408 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.658623 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.658737 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.658944 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.659044 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.659275 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.659374 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.659598 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.659699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.659911 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.660020 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.660226 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.660325 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.660542 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.660649 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.660855 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.660969 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.661168 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.661275 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.661501 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.661604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.661816 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.661910 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.662126 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.662254 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.662444 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.662554 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.662757 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.662854 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.663067 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.663188 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.663380 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.663481 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.663688 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.663789 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.664020 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.664121 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.664330 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.664429 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.664639 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.664730 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.664945 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.665050 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.665262 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.665463 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.665608 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.665762 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.665917 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.666070 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.666214 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.666357 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.666507 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.666656 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.666813 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.666964 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.667660 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.667821 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.667974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.668125 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.668302 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.668465 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.668610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.668766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.668910 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.669057 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.669210 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.669353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.669539 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.669685 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.669828 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.669980 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.670130 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.670369 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.670536 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.670683 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.670826 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.670980 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.670980 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.671332 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.671475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.671475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.671742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.671896 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.672045 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.672186 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.672356 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.672520 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.672658 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.672883 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.673028 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.673140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.673140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.673405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.673685 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.673799 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.673894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.673988 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.674074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.674167 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.674267 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.674390 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.674485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.674693 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.674787 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.675000 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.675104 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.675304 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.675403 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.675633 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.675727 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.675953 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.676062 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.676270 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.676372 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.676587 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.676689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.676900 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.677001 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.677213 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.677312 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.677547 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.677684 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.677871 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.677966 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.678192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.678319 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.678507 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.678616 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.678817 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.678919 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.679129 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.679229 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.679442 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.679543 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.679754 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.679856 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.680066 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.680165 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.680381 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.680503 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.680701 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.680804 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.681013 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.681114 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.681340 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.681488 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.681688 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.681790 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.681993 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.682093 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.682310 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.682423 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.682622 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.682740 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.682936 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.683040 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.683249 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.683435 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.683558 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.683666 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.683890 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.684000 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.684199 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.684309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.684511 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.684622 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.684816 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.684935 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.685128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.685232 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.685459 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.685579 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.685780 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.685896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.686229 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.686341 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.686438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.686715 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.686810 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.687031 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.687126 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.687350 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.687442 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.687672 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.687771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.687984 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.688079 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.688308 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.688409 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.688632 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.688736 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.688969 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.689062 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.689284 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.689376 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.689623 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.689732 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.689935 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.690049 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.690244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.690340 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.690559 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.690676 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.690872 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.690973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.691117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 11:45:35.691219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.691480 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.691785 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.692099 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.692411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.692722 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.693086 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.693450 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.693723 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.693990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.694301 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.694610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.694917 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.695225 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.695530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.695845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.696148 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.696456 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.696761 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.697068 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.697371 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.697733 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.698081 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.698399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.698728 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.699044 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.699370 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.699684 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.700010 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.700337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.700659 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.700971 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.701307 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.701647 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.702645 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.703064 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.703389 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.703710 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.704084 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.704356 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.704685 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.704999 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.705326 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.705672 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.705997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.706316 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.706628 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.706960 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.707275 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.707588 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.707906 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.708220 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.708531 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.708846 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.709157 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.709492 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.709814 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.710133 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.710462 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.710791 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.711102 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.711429 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.711755 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.712107 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.712422 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.712769 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.713100 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.713438 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.713751 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.714062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 11:45:35.714308 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 11:45:35.752590 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO dbcounter [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] Registered counter for database nova_api Jul 29 11:45:35.773952 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_db.sqlalchemy.engines [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:45:35.776544 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO dbcounter [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] Registered counter for database nova_api Jul 29 11:45:35.781009 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writer thread running {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:45:35.797952 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_db.sqlalchemy.engines [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:45:35.804717 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writer thread running {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:45:35.836886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.context [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),606e82e5-84db-457f-9bee-6019fb6dd605(cell1) {{(pid=129585) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 11:45:35.841056 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:45:35.843351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:45:35.844139 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:45:35.846173 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:45:35.848141 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO dbcounter [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] Registered counter for database nova_cell0 Jul 29 11:45:35.852154 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO dbcounter [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] Registered counter for database nova_cell1 Jul 29 11:45:35.860319 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_db.sqlalchemy.engines [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:45:35.861673 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_db.sqlalchemy.engines [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:45:35.864039 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.context [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),606e82e5-84db-457f-9bee-6019fb6dd605(cell1) {{(pid=129584) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 11:45:35.868514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:45:35.868930 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writer thread running {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:45:35.870151 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:45:35.870937 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:45:35.872956 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:45:35.875349 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO dbcounter [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] Registered counter for database nova_cell0 Jul 29 11:45:35.879536 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO dbcounter [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] Registered counter for database nova_cell1 Jul 29 11:45:35.886697 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_db.sqlalchemy.engines [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:45:35.892493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_db.sqlalchemy.engines [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:45:35.896889 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writer thread running {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:45:36.014780 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writer thread running {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:45:36.026472 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO dbcounter [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] Registered counter for database nova_cell0 Jul 29 11:45:36.034315 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_db.sqlalchemy.engines [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:45:36.038871 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writer thread running {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:45:36.039520 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writer thread running {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:45:36.050588 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO dbcounter [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] Registered counter for database nova_cell0 Jul 29 11:45:36.058197 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_db.sqlalchemy.engines [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 11:45:36.063300 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writer thread running {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 11:45:36.375728 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: WARNING keystonemiddleware.auth_token [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 11:45:36.383303 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: WARNING keystonemiddleware.auth_token [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 11:45:36.391502 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: WARNING keystonemiddleware.auth_token [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 11:45:36.398870 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: WARNING keystonemiddleware.auth_token [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 11:45:36.735227 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: WARNING keystonemiddleware.auth_token [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 11:45:36.741299 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: WARNING keystonemiddleware.auth_token [None req-0dbf9a2d-79b0-406c-8d47-ed1bd6e4b731 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 11:45:36.743882 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: WARNING keystonemiddleware.auth_token [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 11:45:36.746798 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dc44bbe9c0 pid: 129585 (default app) Jul 29 11:45:36.750461 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: WARNING keystonemiddleware.auth_token [None req-4d40cf26-af7f-47dc-b180-9c272f4b8d68 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 11:45:36.756874 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dc44bbe9c0 pid: 129584 (default app) Jul 29 11:46:17.708605 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=3 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:17.709613 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=3 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:17.710617 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=3 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:17.711945 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=3 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:18.051777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=3 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:18.055489 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=3 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:18.063889 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=3 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:18.070343 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=3 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:19.335111 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-7662c45d-f45c-48cd-a162-d9ddefb2526e tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Action: 'create', calling method: .version_select at 0x7f68fc027ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2020387340"}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:46:19.503392 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-db36d1df-6f64-4eaa-902c-603e32e9f9af tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] Action: 'create', calling method: .version_select at 0x7f68fc024f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1849889149", "metadata": {"Type": "work"}}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:46:21.518452 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-7662c45d-f45c-48cd-a162-d9ddefb2526e tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.820516 Jul 29 11:46:21.519187 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1155 bytes} [Fri Jul 29 11:46:17 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3823 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 29 11:46:21.534807 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-0465eae1-4c43-445c-84c2-ce8a78f823ae tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Calling method '.version_select at 0x7f68fbeabd30>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:21.664385 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-db36d1df-6f64-4eaa-902c-603e32e9f9af tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.627403 Jul 29 11:46:21.666057 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 1/2] 10.222.0.60 () {60 vars in 1156 bytes} [Fri Jul 29 11:46:18 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3632 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 29 11:46:21.682264 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-49f9c002-991b-498e-82bb-cc7194743ffe tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] Calling method '.version_select at 0x7f68fbeaadc0>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:21.821910 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-0465eae1-4c43-445c-84c2-ce8a78f823ae tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb" status: 200 len: 345 microversion: 2.1 time: 0.291786 Jul 29 11:46:21.822874 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:46:21 2022] GET /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb => generated 345 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:22.065004 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-49f9c002-991b-498e-82bb-cc7194743ffe tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e" status: 200 len: 353 microversion: 2.1 time: 0.387122 Jul 29 11:46:22.071814 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:46:21 2022] GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e => generated 353 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:22.835883 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-dbc7f8f3-13c8-43f4-8539-5559451e0c05 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Calling method '.version_select at 0x7f68fbebc430>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:22.964471 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-dbc7f8f3-13c8-43f4-8539-5559451e0c05 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb" status: 200 len: 346 microversion: 2.1 time: 0.132412 Jul 29 11:46:22.969554 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 3/5] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:46:22 2022] GET /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb => generated 346 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:22.980739 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e83a2691-ec1b-416f-8955-0fba35157ecd tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Action: 'create', calling method: .version_select at 0x7f68fbebc430>, body: {"snapshot": {"volume_id": "8d0dec13-c77c-4c53-948d-2c23b2c65dcb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-973847725"}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:46:23.089126 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-dce3af09-3660-4571-a7bc-ad765154e5ff tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] Calling method '.version_select at 0x7f68fbebcaf0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:23.252049 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-dce3af09-3660-4571-a7bc-ad765154e5ff tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e" status: 200 len: 354 microversion: 2.1 time: 0.175722 Jul 29 11:46:23.252662 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 4/6] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:46:23 2022] GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e => generated 354 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:23.267882 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ab7796d6-5ee1-4291-842b-251a4b3cf9de tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] Calling method '.version_select at 0x7f68fbeabca0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:23.514396 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ab7796d6-5ee1-4291-842b-251a4b3cf9de tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e" status: 200 len: 354 microversion: 2.1 time: 0.252997 Jul 29 11:46:23.515334 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 5/7] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:46:23 2022] GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e => generated 354 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:23.533129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ce2fd39d-f6ff-4989-8331-029c4cc6813d tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] Calling method '.version_select at 0x7f68fbebc9d0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:23.690783 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e83a2691-ec1b-416f-8955-0fba35157ecd tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.714611 Jul 29 11:46:23.693936 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 3/8] 10.222.0.60 () {60 vars in 1162 bytes} [Fri Jul 29 11:46:22 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:23.707267 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c4eb5ed0-dac9-4dde-bf78-ebbe05594402 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Calling method '.version_select at 0x7f68fbec0670>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:23.801106 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ce2fd39d-f6ff-4989-8331-029c4cc6813d tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e" status: 202 len: 0 microversion: 2.1 time: 0.271837 Jul 29 11:46:23.805297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 6/9] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Jul 29 11:46:23 2022] DELETE /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:46:23.819317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-2b815618-fe23-4b3d-8c4b-d430461bd1cb tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] Calling method '.version_select at 0x7f68fbebc310>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:23.892736 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c4eb5ed0-dac9-4dde-bf78-ebbe05594402 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a" status: 200 len: 286 microversion: 2.1 time: 0.193461 Jul 29 11:46:23.899207 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 4/10] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Jul 29 11:46:23 2022] GET /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a => generated 286 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:23.904449 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-026ac938-9302-449e-8638-ac732e0a3814 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Calling method '.version_select at 0x7f68fbebcdc0>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:24.019478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-2b815618-fe23-4b3d-8c4b-d430461bd1cb tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e" status: 200 len: 353 microversion: 2.1 time: 0.210981 Jul 29 11:46:24.026852 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 7/11] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:46:23 2022] GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e => generated 353 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:24.048676 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-026ac938-9302-449e-8638-ac732e0a3814 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.148048 Jul 29 11:46:24.049195 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 5/12] 10.222.0.60 () {58 vars in 1140 bytes} [Fri Jul 29 11:46:23 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:46:24.062406 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-d68ed1dc-3565-40db-aebf-68db6b6e81b4 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Calling method '.version_select at 0x7f68fbeabdc0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:24.128249 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-d68ed1dc-3565-40db-aebf-68db6b6e81b4 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a" status: 200 len: 286 microversion: 2.1 time: 0.071623 Jul 29 11:46:24.129358 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 8/13] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Jul 29 11:46:24 2022] GET /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:25.035813 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-cf0713a2-04a5-4f5a-9edd-de627fc69ef4 tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] Calling method '.version_select at 0x7f68fbec0310>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:25.142311 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-1a68f09a-0408-4e6d-af6b-9f7d7168d81e tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Calling method '.version_select at 0x7f68fbebc5e0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:25.194800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-cf0713a2-04a5-4f5a-9edd-de627fc69ef4 tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e" status: 200 len: 353 microversion: 2.1 time: 0.162761 Jul 29 11:46:25.195603 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 6/14] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:46:25 2022] GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e => generated 353 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:25.352055 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-1a68f09a-0408-4e6d-af6b-9f7d7168d81e tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a" status: 200 len: 286 microversion: 2.1 time: 0.214687 Jul 29 11:46:25.356436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 9/15] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Jul 29 11:46:25 2022] GET /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a => generated 286 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:26.210647 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4c91e0e6-0f0b-4be1-a2a0-525b189ed60b tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] Calling method '.version_select at 0x7f68fbec01f0>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:26.289938 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-4c91e0e6-0f0b-4be1-a2a0-525b189ed60b tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e" status: 200 len: 353 microversion: 2.1 time: 0.084405 Jul 29 11:46:26.290936 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 7/16] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:46:26 2022] GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:26.365655 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c756d37a-d14d-4e16-847c-65adfb28182d tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Calling method '.version_select at 0x7f68fbebcd30>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:26.415514 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-c756d37a-d14d-4e16-847c-65adfb28182d tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a" status: 200 len: 286 microversion: 2.1 time: 0.053423 Jul 29 11:46:26.416472 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 10/17] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Jul 29 11:46:26 2022] GET /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:27.310592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c0c6c1fe-e0da-4efb-b9f4-aa2ced63b646 tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] Calling method '.version_select at 0x7f68fbeaaf70>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:27.414253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c0c6c1fe-e0da-4efb-b9f4-aa2ced63b646 tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e" status: 200 len: 353 microversion: 2.1 time: 0.112734 Jul 29 11:46:27.415613 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 8/18] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:46:27 2022] GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:27.429007 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9d837948-623f-4a16-a64d-3f14dd9a9c4a tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Calling method '.version_select at 0x7f68fbebcca0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:27.498647 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9d837948-623f-4a16-a64d-3f14dd9a9c4a tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a" status: 200 len: 287 microversion: 2.1 time: 0.074370 Jul 29 11:46:27.499935 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 11/19] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Jul 29 11:46:27 2022] GET /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:27.513519 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ec64e345-c12c-40f9-b090-2970ba27fff1 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Calling method '.version_select at 0x7f68fbebc280>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:27.683354 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ec64e345-c12c-40f9-b090-2970ba27fff1 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a" status: 202 len: 0 microversion: 2.1 time: 0.170812 Jul 29 11:46:27.692177 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 9/20] 10.222.0.60 () {58 vars in 1254 bytes} [Fri Jul 29 11:46:27 2022] DELETE /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 11:46:27.698327 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-d790ca29-7994-48be-a627-d1c9b26ce46d tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Calling method '.version_select at 0x7f68fbebc5e0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:27.759091 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-d790ca29-7994-48be-a627-d1c9b26ce46d tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a" status: 200 len: 286 microversion: 2.1 time: 0.066183 Jul 29 11:46:27.759660 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 12/21] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Jul 29 11:46:27 2022] GET /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:46:28.433092 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-0db1ecf3-c093-4d50-ab5b-8e68f6c1a478 tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] Calling method '.version_select at 0x7f68fbebcd30>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:28.490754 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-0db1ecf3-c093-4d50-ab5b-8e68f6c1a478 tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] HTTP exception thrown: Volume edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e could not be found. Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-0db1ecf3-c093-4d50-ab5b-8e68f6c1a478 tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] Request method failure captured: Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e HTTP/1.1 Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48iJCN2kETHQDve-1mVhu2YKa-FtzVu2Y-j6M-8cFgOHoyK1Sfv3o5Gkz_8_7J9fA8TRyV1TFujxCzc2l_PONO1Rf-uT1PpoeS_YAPqy_-_OkZunTYBBFuhpUnSvTVVD2roiWFJLrtENnYswo9AcFNeD1NgMukfEjc_uuPACKt8QN_A Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 7e6a56cc24794db2aa79d43a94c28226 Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-VolumesGetTestJSON-1080014049 Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:46:28.496159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:46:28.498284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7e6a56cc24794db2aa79d43a94c28226"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7e6a56cc24794db2aa79d43a94c28226", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7e6a56cc24794db2aa79d43a94c28226"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7e6a56cc24794db2aa79d43a94c28226"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:46:28.498284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-VolumesGetTestJSON-1080014049 Jul 29 11:46:28.498284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 7e6a56cc24794db2aa79d43a94c28226 Jul 29 11:46:28.498284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-VolumesGetTestJSON-1080014049 Jul 29 11:46:28.498284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-VolumesGetTestJSON-1080014049-project Jul 29 11:46:28.498284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:46:28.498284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:46:28.498284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 8017ab3d0706435aa920657a00405425 Jul 29 11:46:28.498284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-VolumesGetTestJSON-1080014049-project Jul 29 11:46:28.498284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: Jul 29 11:46:28.498284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Volume edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e could not be found. Jul 29 11:46:28.498284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': 'edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e'} Jul 29 11:46:28.498284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e could not be found. (HTTP 404) (Request-ID: req-b8fec410-bcd8-495a-b5aa-fdae04381121) Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:46:28.499109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 11:46:28.500248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e could not be found. Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 11:46:28.501170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:46:28.502315 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e could not be found. Jul 29 11:46:28.502315 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:28.502315 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:46:28.502315 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:28.502315 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:28.502315 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:46:28.502315 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:46:28.502315 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:46:28.502315 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:46:28.502315 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e could not be found. Jul 29 11:46:28.502315 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:28.503831 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-0db1ecf3-c093-4d50-ab5b-8e68f6c1a478 tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] Returning 404 to user: Volume edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:46:28.504996 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-0db1ecf3-c093-4d50-ab5b-8e68f6c1a478 tempest-VolumesGetTestJSON-1080014049 tempest-VolumesGetTestJSON-1080014049-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e" status: 404 len: 109 microversion: 2.1 time: 0.077487 Jul 29 11:46:28.505760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 10/22] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:46:28 2022] GET /compute/v2.1/os-volumes/edc8f3f3-ac6f-4d52-8ff5-db941cf9f33e => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:46:28.774116 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9c6869e8-1887-41af-8f3b-c28025eff1d7 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Calling method '.version_select at 0x7f68fbec0550>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:28.826572 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-9c6869e8-1887-41af-8f3b-c28025eff1d7 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] HTTP exception thrown: Snapshot 63ec2739-22dd-40c1-b123-31aae74c072a could not be found. Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9c6869e8-1887-41af-8f3b-c28025eff1d7 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Request method failure captured: Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a HTTP/1.1 Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48iJfyNWjUS7x0PlNcSb1946LJba8sehv2y5cskpA67ZCATlMc8HSiRw5qlRyNdAmcGqucTkeCK84L7g_5tArcEgigCDM1j6z1mvmbEpKL2-85IURNjbEKH1SKEYJhIFd0hF1Iur_-_upAt045XjZkzoB02ONEJV-BnnnTSAroGlnkA Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 4f1a81a798d54d0eb9a787289be6f550 Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1145051523 Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:46:28.830990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:46:28.832307 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4f1a81a798d54d0eb9a787289be6f550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4f1a81a798d54d0eb9a787289be6f550", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4f1a81a798d54d0eb9a787289be6f550"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4f1a81a798d54d0eb9a787289be6f550"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:46:28.832307 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1145051523 Jul 29 11:46:28.832307 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 4f1a81a798d54d0eb9a787289be6f550 Jul 29 11:46:28.832307 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1145051523 Jul 29 11:46:28.832307 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-VolumesSnapshotsTestJSON-1145051523-project Jul 29 11:46:28.832307 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:46:28.832307 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:46:28.832307 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: a64cc54aaea748538d67bc07861f0d3b Jul 29 11:46:28.832307 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1145051523-project Jul 29 11:46:28.832307 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: Jul 29 11:46:28.832307 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Snapshot 63ec2739-22dd-40c1-b123-31aae74c072a could not be found. Jul 29 11:46:28.832307 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '63ec2739-22dd-40c1-b123-31aae74c072a'} Jul 29 11:46:28.832307 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 63ec2739-22dd-40c1-b123-31aae74c072a could not be found. (HTTP 404) (Request-ID: req-24712fd0-8b89-4de6-9b1f-e1491150409c) Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:28.833060 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 11:46:28.833997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 63ec2739-22dd-40c1-b123-31aae74c072a could not be found. Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 29 11:46:28.835974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:46:28.836989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 63ec2739-22dd-40c1-b123-31aae74c072a could not be found. Jul 29 11:46:28.836989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:28.836989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:46:28.836989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:28.836989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:28.836989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:46:28.836989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:46:28.836989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:46:28.836989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:46:28.836989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 63ec2739-22dd-40c1-b123-31aae74c072a could not be found. Jul 29 11:46:28.836989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:28.841657 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9c6869e8-1887-41af-8f3b-c28025eff1d7 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Returning 404 to user: Snapshot 63ec2739-22dd-40c1-b123-31aae74c072a could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:46:28.842967 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-9c6869e8-1887-41af-8f3b-c28025eff1d7 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a" status: 404 len: 111 microversion: 2.1 time: 0.074017 Jul 29 11:46:28.852873 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 11/23] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Jul 29 11:46:28 2022] GET /compute/v2.1/os-snapshots/63ec2739-22dd-40c1-b123-31aae74c072a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:46:28.863986 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c63101bc-5b9e-4cd1-94df-abf2415cd1ce tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Calling method '.version_select at 0x7f68fbec0430>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:29.020370 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c63101bc-5b9e-4cd1-94df-abf2415cd1ce tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb" status: 202 len: 0 microversion: 2.1 time: 0.166108 Jul 29 11:46:29.021110 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 12/24] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Jul 29 11:46:28 2022] DELETE /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:46:29.033311 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-7c7c725b-5a27-44af-b5de-e27e753fdceb tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Calling method '.version_select at 0x7f68fbec0f70>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:29.053453 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6a07fcb7-bf5b-405d-9a76-5ebe0325216c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1784274274", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452", "networks": [{"uuid": "81221c9c-f0f4-4095-981a-fd6e3dcd5aa3"}]}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:46:29.163558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-7c7c725b-5a27-44af-b5de-e27e753fdceb tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb" status: 200 len: 345 microversion: 2.1 time: 0.137767 Jul 29 11:46:29.164611 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 13/25] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:46:29 2022] GET /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb => generated 345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:46:29.412775 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.network.neutron [None req-6a07fcb7-bf5b-405d-9a76-5ebe0325216c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] validate_networks() for [('81221c9c-f0f4-4095-981a-fd6e3dcd5aa3', None, None, None, None, None)] {{(pid=129585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:46:30.180484 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-7f0902d0-9bdf-4584-87b5-2ac1b67adb44 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Calling method '.version_select at 0x7f68fbe36670>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:30.235774 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-7f0902d0-9bdf-4584-87b5-2ac1b67adb44 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] HTTP exception thrown: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-7f0902d0-9bdf-4584-87b5-2ac1b67adb44 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Request method failure captured: Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb HTTP/1.1 Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48iJfyNWjUS7x0PlNcSb1946LJba8sehv2y5cskpA67ZCATlMc8HSiRw5qlRyNdAmcGqucTkeCK84L7g_5tArcEgigCDM1j6z1mvmbEpKL2-85IURNjbEKH1SKEYJhIFd0hF1Iur_-_upAt045XjZkzoB02ONEJV-BnnnTSAroGlnkA Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 4f1a81a798d54d0eb9a787289be6f550 Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1145051523 Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:46:30.237746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:46:30.238985 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4f1a81a798d54d0eb9a787289be6f550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4f1a81a798d54d0eb9a787289be6f550", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4f1a81a798d54d0eb9a787289be6f550"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4f1a81a798d54d0eb9a787289be6f550"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:46:30.238985 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1145051523 Jul 29 11:46:30.238985 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 4f1a81a798d54d0eb9a787289be6f550 Jul 29 11:46:30.238985 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1145051523 Jul 29 11:46:30.238985 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-VolumesSnapshotsTestJSON-1145051523-project Jul 29 11:46:30.238985 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:46:30.238985 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:46:30.238985 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: a64cc54aaea748538d67bc07861f0d3b Jul 29 11:46:30.238985 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1145051523-project Jul 29 11:46:30.238985 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: Jul 29 11:46:30.238985 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. Jul 29 11:46:30.238985 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '8d0dec13-c77c-4c53-948d-2c23b2c65dcb'} Jul 29 11:46:30.238985 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. (HTTP 404) (Request-ID: req-20aa33f1-3f70-410d-bdac-6dd33e0bc18e) Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:46:30.239972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 11:46:30.241253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 11:46:30.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:46:30.243547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. Jul 29 11:46:30.243547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.243547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:46:30.243547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.243547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:30.243547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:46:30.243547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:46:30.243547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:46:30.243547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:46:30.243547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. Jul 29 11:46:30.243547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.243547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-7f0902d0-9bdf-4584-87b5-2ac1b67adb44 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Returning 404 to user: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:46:30.243547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-7f0902d0-9bdf-4584-87b5-2ac1b67adb44 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb" status: 404 len: 109 microversion: 2.1 time: 0.062438 Jul 29 11:46:30.243547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 14/26] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:46:30 2022] GET /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:46:30.258701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-685d128a-8ff1-493b-a572-7e499802ef89 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Calling method '.version_select at 0x7f68fbec0940>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:30.303532 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-685d128a-8ff1-493b-a572-7e499802ef89 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] HTTP exception thrown: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-685d128a-8ff1-493b-a572-7e499802ef89 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Request method failure captured: Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: DELETE /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb HTTP/1.1 Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48iJfyNWjUS7x0PlNcSb1946LJba8sehv2y5cskpA67ZCATlMc8HSiRw5qlRyNdAmcGqucTkeCK84L7g_5tArcEgigCDM1j6z1mvmbEpKL2-85IURNjbEKH1SKEYJhIFd0hF1Iur_-_upAt045XjZkzoB02ONEJV-BnnnTSAroGlnkA Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 4f1a81a798d54d0eb9a787289be6f550 Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1145051523 Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:46:30.305509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:46:30.306817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4f1a81a798d54d0eb9a787289be6f550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4f1a81a798d54d0eb9a787289be6f550", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4f1a81a798d54d0eb9a787289be6f550"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4f1a81a798d54d0eb9a787289be6f550"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:46:30.306817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1145051523 Jul 29 11:46:30.306817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 4f1a81a798d54d0eb9a787289be6f550 Jul 29 11:46:30.306817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1145051523 Jul 29 11:46:30.306817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-VolumesSnapshotsTestJSON-1145051523-project Jul 29 11:46:30.306817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:46:30.306817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:46:30.306817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: a64cc54aaea748538d67bc07861f0d3b Jul 29 11:46:30.306817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1145051523-project Jul 29 11:46:30.306817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: Jul 29 11:46:30.306817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. Jul 29 11:46:30.306817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '8d0dec13-c77c-4c53-948d-2c23b2c65dcb'} Jul 29 11:46:30.306817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. (HTTP 404) (Request-ID: req-94f80f01-fbea-4f14-8774-4029285fea77) Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:46:30.307514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 11:46:30.308703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 11:46:30.310558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:46:30.311900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. Jul 29 11:46:30.311900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.311900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:46:30.311900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.311900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:30.311900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:46:30.311900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:46:30.311900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:46:30.311900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:46:30.311900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. Jul 29 11:46:30.311900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.311900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-685d128a-8ff1-493b-a572-7e499802ef89 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Returning 404 to user: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:46:30.311900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-685d128a-8ff1-493b-a572-7e499802ef89 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb" status: 404 len: 109 microversion: 2.1 time: 0.052166 Jul 29 11:46:30.311900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 15/27] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Jul 29 11:46:30 2022] DELETE /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 11:46:30.316793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-53893fce-09a4-44ba-a75d-3dfe1b840902 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Calling method '.version_select at 0x7f68fc024f70>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:30.398712 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-53893fce-09a4-44ba-a75d-3dfe1b840902 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] HTTP exception thrown: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-53893fce-09a4-44ba-a75d-3dfe1b840902 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Request method failure captured: Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb HTTP/1.1 Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48iJfyNWjUS7x0PlNcSb1946LJba8sehv2y5cskpA67ZCATlMc8HSiRw5qlRyNdAmcGqucTkeCK84L7g_5tArcEgigCDM1j6z1mvmbEpKL2-85IURNjbEKH1SKEYJhIFd0hF1Iur_-_upAt045XjZkzoB02ONEJV-BnnnTSAroGlnkA Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 4f1a81a798d54d0eb9a787289be6f550 Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1145051523 Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:46:30.400634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:46:30.401677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4f1a81a798d54d0eb9a787289be6f550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4f1a81a798d54d0eb9a787289be6f550", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4f1a81a798d54d0eb9a787289be6f550"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4f1a81a798d54d0eb9a787289be6f550"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:46:30.401677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1145051523 Jul 29 11:46:30.401677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 4f1a81a798d54d0eb9a787289be6f550 Jul 29 11:46:30.401677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1145051523 Jul 29 11:46:30.401677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-VolumesSnapshotsTestJSON-1145051523-project Jul 29 11:46:30.401677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:46:30.401677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:46:30.401677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: a64cc54aaea748538d67bc07861f0d3b Jul 29 11:46:30.401677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1145051523-project Jul 29 11:46:30.401677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: Jul 29 11:46:30.401677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. Jul 29 11:46:30.401677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '8d0dec13-c77c-4c53-948d-2c23b2c65dcb'} Jul 29 11:46:30.401677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. (HTTP 404) (Request-ID: req-25852442-6b85-4238-9e30-b7d351c61405) Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:46:30.402445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 11:46:30.408407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 11:46:30.410800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:46:30.411709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. Jul 29 11:46:30.411709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.411709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:46:30.411709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.411709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:46:30.411709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:46:30.411709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:46:30.411709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:46:30.411709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:46:30.411709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. Jul 29 11:46:30.411709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:46:30.411709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-53893fce-09a4-44ba-a75d-3dfe1b840902 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] Returning 404 to user: Volume 8d0dec13-c77c-4c53-948d-2c23b2c65dcb could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:46:30.411709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-53893fce-09a4-44ba-a75d-3dfe1b840902 tempest-VolumesSnapshotsTestJSON-1145051523 tempest-VolumesSnapshotsTestJSON-1145051523-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb" status: 404 len: 109 microversion: 2.1 time: 0.089639 Jul 29 11:46:30.411709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 16/28] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:46:30 2022] GET /compute/v2.1/os-volumes/8d0dec13-c77c-4c53-948d-2c23b2c65dcb => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:46:31.114792 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-bab59b13-3e50-476d-8d93-0d4729fe9860 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Action: 'create', calling method: .version_select at 0x7f68fbec08b0>, body: {"keypair": {"name": "tempest-keypair-1319657418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZcFjST1AY9Ng1zWlY0Th30mjFqYIk0CiJHZa9WuqcoonfAbcPa9MfrKJQh7fqusa38uFIFGuAHbmkG0Dd29mIoT/N/NQwn0W42IQ2zxg90CAhArMStEOv3qIxHeLv2VQ=="}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:46:31.287063 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-bab59b13-3e50-476d-8d93-0d4729fe9860 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Getting quotas for project 90047b9130334326ad98280a8edb2bc6. Resources: {'key_pairs'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:46:31.310815 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-bab59b13-3e50-476d-8d93-0d4729fe9860 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Getting quotas for user ee3506015d9240258cbada860704dffe and project 90047b9130334326ad98280a8edb2bc6. Resources: {'key_pairs'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:46:31.494778 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-bab59b13-3e50-476d-8d93-0d4729fe9860 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.870789 Jul 29 11:46:31.495397 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 17/29] 10.222.0.60 () {62 vars in 1200 bytes} [Fri Jul 29 11:46:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 872 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 29 11:46:34.532893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-6a07fcb7-bf5b-405d-9a76-5ebe0325216c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Flavor limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:46:34.532893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-6a07fcb7-bf5b-405d-9a76-5ebe0325216c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Image limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:46:34.532893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-6a07fcb7-bf5b-405d-9a76-5ebe0325216c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Flavor pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:46:34.532893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-6a07fcb7-bf5b-405d-9a76-5ebe0325216c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Image pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:46:34.533582 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-6a07fcb7-bf5b-405d-9a76-5ebe0325216c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:46:34.571463 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6a07fcb7-bf5b-405d-9a76-5ebe0325216c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:34.571922 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6a07fcb7-bf5b-405d-9a76-5ebe0325216c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:34.573794 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6a07fcb7-bf5b-405d-9a76-5ebe0325216c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:34.573794 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6a07fcb7-bf5b-405d-9a76-5ebe0325216c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:34.714578 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-6a07fcb7-bf5b-405d-9a76-5ebe0325216c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Getting quotas for project 3261a30431d343a1bb170b67199c0903. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:46:34.732028 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-6a07fcb7-bf5b-405d-9a76-5ebe0325216c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Getting quotas for user 966689d952e14c1fb9007f2bdd7f03d3 and project 3261a30431d343a1bb170b67199c0903. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:46:34.776908 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6a07fcb7-bf5b-405d-9a76-5ebe0325216c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Going to run 1 instances... {{(pid=129585) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:46:34.788091 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6a07fcb7-bf5b-405d-9a76-5ebe0325216c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:46:35.023781 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6a07fcb7-bf5b-405d-9a76-5ebe0325216c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.454506 Jul 29 11:46:35.036086 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 13/30] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:46:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 6468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 11:46:35.038612 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-8c1085ca-96f2-4525-96f5-ace7b3e4d95e tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:35.039577 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-8c1085ca-96f2-4525-96f5-ace7b3e4d95e tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:35.950482 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-8c1085ca-96f2-4525-96f5-ace7b3e4d95e tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:36.024508 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-8c1085ca-96f2-4525-96f5-ace7b3e4d95e tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1215 microversion: 2.1 time: 0.989824 Jul 29 11:46:36.031582 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 18/31] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:35 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1215 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:46:37.052785 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c0dfb618-3fbb-4d31-8fb7-de7c55e777bb tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:37.054198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c0dfb618-3fbb-4d31-8fb7-de7c55e777bb tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:37.304394 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c0dfb618-3fbb-4d31-8fb7-de7c55e777bb tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:37.324091 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c0dfb618-3fbb-4d31-8fb7-de7c55e777bb tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1215 microversion: 2.1 time: 0.274616 Jul 29 11:46:37.332695 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 19/32] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:37 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1215 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:46:37.843074 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-06173d7a-1a6d-40ff-933a-5579e9bc0c3f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1316572852", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:46:37.904776 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-efdcc907-ea98-4d81-a108-8371cc2660bd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Action: 'create', calling method: .version_select at 0x7f68fbdc79d0>, body: {"keypair": {"name": "tempest-keypair-1790542709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIP2Skql3dvf4XJfAex0FhO6Rp3Yte1DR2ANlg5iJJyRBpm4WQU/kIZCkE1atTXs8j+HH5mth78nZJW2D0/4Rj3/U4am2PAMenUHFDP1ttHBpu7bTnvvtro+xFcRdYrl/g=="}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:46:37.994537 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-efdcc907-ea98-4d81-a108-8371cc2660bd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Getting quotas for project 6a4b9969357142bc8724804eb47e0c48. Resources: {'key_pairs'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:46:38.017015 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-efdcc907-ea98-4d81-a108-8371cc2660bd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Getting quotas for user 1a343996462b462d86fb89b876f4e127 and project 6a4b9969357142bc8724804eb47e0c48. Resources: {'key_pairs'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:46:38.026912 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.network.neutron [None req-06173d7a-1a6d-40ff-933a-5579e9bc0c3f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] validate_networks() for [('4303157a-2669-4080-b15b-7be339c78e2e', None, None, None, None, None)] {{(pid=129584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:46:38.129810 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-efdcc907-ea98-4d81-a108-8371cc2660bd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.117362 Jul 29 11:46:38.131192 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 14/33] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Jul 29 11:46:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:38.352306 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-7aaf31b5-abc9-48cb-b5be-b4abe22bfab6 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:38.353261 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-7aaf31b5-abc9-48cb-b5be-b4abe22bfab6 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:38.478119 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-7aaf31b5-abc9-48cb-b5be-b4abe22bfab6 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:38.503950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-7aaf31b5-abc9-48cb-b5be-b4abe22bfab6 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1215 microversion: 2.1 time: 0.154516 Jul 29 11:46:38.519782 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 15/34] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:38 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:46:39.184153 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-55be67e4-94f5-4b14-8e87-05a153de2d17 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-883609782", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "880bbcc5-592e-4ef5-8c48-acff52af8368"}], "security_groups": [{"name": "tempest-securitygroup--474760872"}], "key_name": "tempest-keypair-1319657418", "user_data": "}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:46:39.714287 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.network.neutron [None req-55be67e4-94f5-4b14-8e87-05a153de2d17 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] validate_networks() for [('880bbcc5-592e-4ef5-8c48-acff52af8368', None, None, None, None, None)] {{(pid=129585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:46:40.785583 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-06173d7a-1a6d-40ff-933a-5579e9bc0c3f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Flavor limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:46:40.786447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-06173d7a-1a6d-40ff-933a-5579e9bc0c3f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Image limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:46:40.786963 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-06173d7a-1a6d-40ff-933a-5579e9bc0c3f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Flavor pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:46:40.787390 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-06173d7a-1a6d-40ff-933a-5579e9bc0c3f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Image pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:46:40.787817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-06173d7a-1a6d-40ff-933a-5579e9bc0c3f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:46:40.811937 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-06173d7a-1a6d-40ff-933a-5579e9bc0c3f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:40.812669 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-06173d7a-1a6d-40ff-933a-5579e9bc0c3f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:40.815250 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-06173d7a-1a6d-40ff-933a-5579e9bc0c3f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:40.816512 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-06173d7a-1a6d-40ff-933a-5579e9bc0c3f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:40.935721 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-06173d7a-1a6d-40ff-933a-5579e9bc0c3f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Getting quotas for project 106664c99e9c4a0d9a9c9c05e08a3d7f. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:46:40.953158 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-06173d7a-1a6d-40ff-933a-5579e9bc0c3f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Getting quotas for user 9d341bba8dda445ca4eac6d52aa9f80c and project 106664c99e9c4a0d9a9c9c05e08a3d7f. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:46:40.997150 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-06173d7a-1a6d-40ff-933a-5579e9bc0c3f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Going to run 1 instances... {{(pid=129584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:46:41.003752 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-06173d7a-1a6d-40ff-933a-5579e9bc0c3f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:46:41.229620 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-06173d7a-1a6d-40ff-933a-5579e9bc0c3f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.736828 Jul 29 11:46:41.231586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 20/35] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:46:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 3740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 11:46:41.246901 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-739dbf7a-76e3-4883-bcbb-2f11d7d2a9af tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:41.249149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-739dbf7a-76e3-4883-bcbb-2f11d7d2a9af tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:41.271114 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-739dbf7a-76e3-4883-bcbb-2f11d7d2a9af tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:41.275714 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-739dbf7a-76e3-4883-bcbb-2f11d7d2a9af tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:41.278819 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-739dbf7a-76e3-4883-bcbb-2f11d7d2a9af tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:41.279469 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-739dbf7a-76e3-4883-bcbb-2f11d7d2a9af tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:41.945033 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-739dbf7a-76e3-4883-bcbb-2f11d7d2a9af tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:41.976794 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-739dbf7a-76e3-4883-bcbb-2f11d7d2a9af tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1273 microversion: 2.1 time: 0.743723 Jul 29 11:46:41.984822 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 21/36] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:41 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1273 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:41.992244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c1c65275-bf2f-4373-8707-947a60bde891 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:41.997782 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c1c65275-bf2f-4373-8707-947a60bde891 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:42.373603 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c1c65275-bf2f-4373-8707-947a60bde891 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:42.385169 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c1c65275-bf2f-4373-8707-947a60bde891 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1222 microversion: 2.1 time: 0.398988 Jul 29 11:46:42.387320 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 22/37] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:41 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1222 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:42.768812 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-0853aeed-4e96-4461-9d31-f8b9ecd2c0b0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1200243091", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:46:42.898491 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.network.neutron [None req-0853aeed-4e96-4461-9d31-f8b9ecd2c0b0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] validate_networks() for [('4303157a-2669-4080-b15b-7be339c78e2e', None, None, None, None, None)] {{(pid=129584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:46:43.841216 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-55be67e4-94f5-4b14-8e87-05a153de2d17 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Flavor limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:46:43.843387 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-55be67e4-94f5-4b14-8e87-05a153de2d17 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Image limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:46:43.844128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-55be67e4-94f5-4b14-8e87-05a153de2d17 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Flavor pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:46:43.845138 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-55be67e4-94f5-4b14-8e87-05a153de2d17 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Image pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:46:43.845822 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-55be67e4-94f5-4b14-8e87-05a153de2d17 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:46:43.867810 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-55be67e4-94f5-4b14-8e87-05a153de2d17 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:43.871423 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-55be67e4-94f5-4b14-8e87-05a153de2d17 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:43.877990 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-55be67e4-94f5-4b14-8e87-05a153de2d17 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:43.878953 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-55be67e4-94f5-4b14-8e87-05a153de2d17 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:43.975855 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-55be67e4-94f5-4b14-8e87-05a153de2d17 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Getting quotas for project 90047b9130334326ad98280a8edb2bc6. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:46:43.989187 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-55be67e4-94f5-4b14-8e87-05a153de2d17 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Getting quotas for user ee3506015d9240258cbada860704dffe and project 90047b9130334326ad98280a8edb2bc6. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:46:44.029449 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-55be67e4-94f5-4b14-8e87-05a153de2d17 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Going to run 1 instances... {{(pid=129585) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:46:44.037244 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-55be67e4-94f5-4b14-8e87-05a153de2d17 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:46:44.159026 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-55be67e4-94f5-4b14-8e87-05a153de2d17 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.983904 Jul 29 11:46:44.172028 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 16/38] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Jul 29 11:46:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 4996 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 29 11:46:44.191953 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e529eb04-2ae4-48a3-9d8f-d9d4c8613b8f tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:44.196742 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e529eb04-2ae4-48a3-9d8f-d9d4c8613b8f tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:44.216440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e529eb04-2ae4-48a3-9d8f-d9d4c8613b8f tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:44.217704 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e529eb04-2ae4-48a3-9d8f-d9d4c8613b8f tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:44.221662 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e529eb04-2ae4-48a3-9d8f-d9d4c8613b8f tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:44.226172 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e529eb04-2ae4-48a3-9d8f-d9d4c8613b8f tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:44.871273 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e529eb04-2ae4-48a3-9d8f-d9d4c8613b8f tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:44.914033 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e529eb04-2ae4-48a3-9d8f-d9d4c8613b8f tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1273 microversion: 2.1 time: 0.740083 Jul 29 11:46:44.922703 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 17/39] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:44 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1273 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:44.950878 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6f9f4b6d-110a-4751-940f-cecd72414581 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-404328084", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8c1956d-5393-448f-8fc5-93aafd4768ba"}], "security_groups": [{"name": "tempest-securitygroup--628329345"}], "key_name": "tempest-keypair-1790542709", "user_data": "}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:46:46.231277 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.network.neutron [None req-6f9f4b6d-110a-4751-940f-cecd72414581 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] validate_networks() for [('b8c1956d-5393-448f-8fc5-93aafd4768ba', None, None, None, None, None)] {{(pid=129585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:46:46.923509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-0853aeed-4e96-4461-9d31-f8b9ecd2c0b0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Flavor limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:46:46.925102 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-0853aeed-4e96-4461-9d31-f8b9ecd2c0b0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Image limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:46:46.925953 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-0853aeed-4e96-4461-9d31-f8b9ecd2c0b0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Flavor pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:46:46.926748 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-0853aeed-4e96-4461-9d31-f8b9ecd2c0b0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Image pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:46:46.927857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-0853aeed-4e96-4461-9d31-f8b9ecd2c0b0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:46:46.947287 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0853aeed-4e96-4461-9d31-f8b9ecd2c0b0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:46.948053 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0853aeed-4e96-4461-9d31-f8b9ecd2c0b0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:46.949471 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0853aeed-4e96-4461-9d31-f8b9ecd2c0b0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:46.953516 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0853aeed-4e96-4461-9d31-f8b9ecd2c0b0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:47.014852 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-0853aeed-4e96-4461-9d31-f8b9ecd2c0b0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Getting quotas for project 106664c99e9c4a0d9a9c9c05e08a3d7f. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:46:47.023361 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-0853aeed-4e96-4461-9d31-f8b9ecd2c0b0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Getting quotas for user 9d341bba8dda445ca4eac6d52aa9f80c and project 106664c99e9c4a0d9a9c9c05e08a3d7f. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:46:47.050097 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-0853aeed-4e96-4461-9d31-f8b9ecd2c0b0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Going to run 1 instances... {{(pid=129584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:46:47.060365 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-0853aeed-4e96-4461-9d31-f8b9ecd2c0b0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:46:47.187294 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-0853aeed-4e96-4461-9d31-f8b9ecd2c0b0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.426645 Jul 29 11:46:47.199939 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 23/40] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:46:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 4434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 11:46:47.204756 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3e57a91e-c0a1-4ab6-9c91-3dc0dad46469 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:47.207841 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3e57a91e-c0a1-4ab6-9c91-3dc0dad46469 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:47.227271 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3e57a91e-c0a1-4ab6-9c91-3dc0dad46469 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:47.228053 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3e57a91e-c0a1-4ab6-9c91-3dc0dad46469 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:47.229226 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3e57a91e-c0a1-4ab6-9c91-3dc0dad46469 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:47.231225 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3e57a91e-c0a1-4ab6-9c91-3dc0dad46469 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:47.401700 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3e57a91e-c0a1-4ab6-9c91-3dc0dad46469 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:47.415915 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3e57a91e-c0a1-4ab6-9c91-3dc0dad46469 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:47.422099 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3e57a91e-c0a1-4ab6-9c91-3dc0dad46469 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:47.427910 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3e57a91e-c0a1-4ab6-9c91-3dc0dad46469 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1333 microversion: 2.20 time: 0.229033 Jul 29 11:46:47.429036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 24/41] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:46:47 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1333 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:46:47.438052 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-27fd9888-8015-42b1-af68-c3a195cd184c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:47.440594 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-27fd9888-8015-42b1-af68-c3a195cd184c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:47.472265 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-27fd9888-8015-42b1-af68-c3a195cd184c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:47.473963 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-27fd9888-8015-42b1-af68-c3a195cd184c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:47.474965 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-27fd9888-8015-42b1-af68-c3a195cd184c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:47.478709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-27fd9888-8015-42b1-af68-c3a195cd184c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:48.156853 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-27fd9888-8015-42b1-af68-c3a195cd184c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:48.172032 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-27fd9888-8015-42b1-af68-c3a195cd184c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1315 microversion: 2.1 time: 0.738769 Jul 29 11:46:48.182308 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 25/42] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:47 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:48.207012 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ff071dea-ad74-40fb-818b-a826c6ddf9d9 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:48.212620 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ff071dea-ad74-40fb-818b-a826c6ddf9d9 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:48.377346 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-6f9f4b6d-110a-4751-940f-cecd72414581 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Flavor limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:46:48.378623 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-6f9f4b6d-110a-4751-940f-cecd72414581 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Image limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:46:48.379267 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-6f9f4b6d-110a-4751-940f-cecd72414581 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Flavor pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:46:48.379929 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-6f9f4b6d-110a-4751-940f-cecd72414581 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Image pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:46:48.380636 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-6f9f4b6d-110a-4751-940f-cecd72414581 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:46:48.405338 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6f9f4b6d-110a-4751-940f-cecd72414581 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:48.406960 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6f9f4b6d-110a-4751-940f-cecd72414581 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:48.409322 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6f9f4b6d-110a-4751-940f-cecd72414581 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:48.410894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6f9f4b6d-110a-4751-940f-cecd72414581 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:48.468471 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-6f9f4b6d-110a-4751-940f-cecd72414581 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Getting quotas for project 6a4b9969357142bc8724804eb47e0c48. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:46:48.472397 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ff071dea-ad74-40fb-818b-a826c6ddf9d9 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:48.479943 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ff071dea-ad74-40fb-818b-a826c6ddf9d9 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1222 microversion: 2.1 time: 0.296200 Jul 29 11:46:48.480531 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 26/43] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:48 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1222 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:48.485445 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-6f9f4b6d-110a-4751-940f-cecd72414581 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Getting quotas for user 1a343996462b462d86fb89b876f4e127 and project 6a4b9969357142bc8724804eb47e0c48. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:46:48.501183 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-cb5c6ee7-0653-4667-89a0-da9a6b160c2f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:48.501842 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-cb5c6ee7-0653-4667-89a0-da9a6b160c2f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:48.530212 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cb5c6ee7-0653-4667-89a0-da9a6b160c2f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:48.534909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cb5c6ee7-0653-4667-89a0-da9a6b160c2f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:48.536113 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cb5c6ee7-0653-4667-89a0-da9a6b160c2f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:48.536735 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cb5c6ee7-0653-4667-89a0-da9a6b160c2f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:48.563076 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6f9f4b6d-110a-4751-940f-cecd72414581 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Going to run 1 instances... {{(pid=129585) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:46:48.587144 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6f9f4b6d-110a-4751-940f-cecd72414581 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:46:48.744407 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6f9f4b6d-110a-4751-940f-cecd72414581 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.817916 Jul 29 11:46:48.751222 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 18/44] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:46:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 3827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 11:46:48.779761 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-7a7e195d-388f-46d3-9ae2-9c4da13f2073 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:48.781656 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-7a7e195d-388f-46d3-9ae2-9c4da13f2073 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:49.559608 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-7a7e195d-388f-46d3-9ae2-9c4da13f2073 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:49.567730 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-7a7e195d-388f-46d3-9ae2-9c4da13f2073 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1241 microversion: 2.1 time: 0.804417 Jul 29 11:46:49.570821 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 19/45] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:48 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1241 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:49.581796 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-597ad538-4114-4755-8e83-dd88d8540eb9 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:49.582780 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-597ad538-4114-4755-8e83-dd88d8540eb9 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:49.587137 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-cb5c6ee7-0653-4667-89a0-da9a6b160c2f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:49.610281 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-cb5c6ee7-0653-4667-89a0-da9a6b160c2f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:49.618757 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-cb5c6ee7-0653-4667-89a0-da9a6b160c2f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:49.631758 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-cb5c6ee7-0653-4667-89a0-da9a6b160c2f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1339 microversion: 2.20 time: 1.146333 Jul 29 11:46:49.634828 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-597ad538-4114-4755-8e83-dd88d8540eb9 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:49.637175 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 27/46] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:46:48 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1339 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:46:49.640836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-597ad538-4114-4755-8e83-dd88d8540eb9 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:49.644982 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-597ad538-4114-4755-8e83-dd88d8540eb9 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:49.647883 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-597ad538-4114-4755-8e83-dd88d8540eb9 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:49.676083 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-8095d5ed-f25a-475f-aec2-0b8b50b823e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:49.689333 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-8095d5ed-f25a-475f-aec2-0b8b50b823e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:49.715532 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8095d5ed-f25a-475f-aec2-0b8b50b823e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:49.716818 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8095d5ed-f25a-475f-aec2-0b8b50b823e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:49.722284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8095d5ed-f25a-475f-aec2-0b8b50b823e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:49.725620 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8095d5ed-f25a-475f-aec2-0b8b50b823e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:50.906407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-8095d5ed-f25a-475f-aec2-0b8b50b823e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:50.937896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-8095d5ed-f25a-475f-aec2-0b8b50b823e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1274 microversion: 2.1 time: 1.287608 Jul 29 11:46:50.960426 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 28/47] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:49 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1274 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:50.981934 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-fee884a4-8bd4-486e-8d8c-f5a73687d9d0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:50.984195 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-fee884a4-8bd4-486e-8d8c-f5a73687d9d0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:51.022530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fee884a4-8bd4-486e-8d8c-f5a73687d9d0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:51.026284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fee884a4-8bd4-486e-8d8c-f5a73687d9d0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:51.028337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fee884a4-8bd4-486e-8d8c-f5a73687d9d0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:51.032117 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fee884a4-8bd4-486e-8d8c-f5a73687d9d0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:52.325801 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-fee884a4-8bd4-486e-8d8c-f5a73687d9d0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:52.347838 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-fee884a4-8bd4-486e-8d8c-f5a73687d9d0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1293 microversion: 2.1 time: 1.380798 Jul 29 11:46:52.352203 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 29/48] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:50 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1293 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:52.374355 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1e21a9e1-8c40-4822-a172-ea03e6a1a1ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:52.378085 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-1e21a9e1-8c40-4822-a172-ea03e6a1a1ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:52.386683 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1e21a9e1-8c40-4822-a172-ea03e6a1a1ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:52.388382 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1e21a9e1-8c40-4822-a172-ea03e6a1a1ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:52.389104 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1e21a9e1-8c40-4822-a172-ea03e6a1a1ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:52.389992 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1e21a9e1-8c40-4822-a172-ea03e6a1a1ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:53.114540 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-597ad538-4114-4755-8e83-dd88d8540eb9 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:53.140478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-597ad538-4114-4755-8e83-dd88d8540eb9 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1315 microversion: 2.1 time: 3.557563 Jul 29 11:46:53.143391 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 20/49] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:49 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1315 bytes in 3570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:53.170491 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-2bfdab3b-dfa9-43e7-b679-79b3374a5c00 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:53.171128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-2bfdab3b-dfa9-43e7-b679-79b3374a5c00 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:53.211142 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2bfdab3b-dfa9-43e7-b679-79b3374a5c00 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:53.217517 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2bfdab3b-dfa9-43e7-b679-79b3374a5c00 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:53.231578 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2bfdab3b-dfa9-43e7-b679-79b3374a5c00 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:53.239224 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2bfdab3b-dfa9-43e7-b679-79b3374a5c00 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:53.925102 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-2bfdab3b-dfa9-43e7-b679-79b3374a5c00 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:53.939432 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-2bfdab3b-dfa9-43e7-b679-79b3374a5c00 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1280 microversion: 2.1 time: 0.790944 Jul 29 11:46:53.946668 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 21/50] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:53 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1280 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:53.956706 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-20e11e39-b93d-48a9-80a9-e4d4b9f16e6b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:53.959181 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-20e11e39-b93d-48a9-80a9-e4d4b9f16e6b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:53.981515 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-20e11e39-b93d-48a9-80a9-e4d4b9f16e6b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:53.993565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-20e11e39-b93d-48a9-80a9-e4d4b9f16e6b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:53.994588 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-20e11e39-b93d-48a9-80a9-e4d4b9f16e6b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:53.995026 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-20e11e39-b93d-48a9-80a9-e4d4b9f16e6b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:54.362080 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-20e11e39-b93d-48a9-80a9-e4d4b9f16e6b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:54.376579 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-20e11e39-b93d-48a9-80a9-e4d4b9f16e6b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1299 microversion: 2.1 time: 0.428635 Jul 29 11:46:54.378694 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 22/51] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:53 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1299 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:54.420525 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-d6488f33-091c-4e53-91dc-861f3ad81a86 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:54.422818 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-d6488f33-091c-4e53-91dc-861f3ad81a86 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:54.446193 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d6488f33-091c-4e53-91dc-861f3ad81a86 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:54.446436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d6488f33-091c-4e53-91dc-861f3ad81a86 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:54.451280 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d6488f33-091c-4e53-91dc-861f3ad81a86 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:54.451731 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d6488f33-091c-4e53-91dc-861f3ad81a86 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:54.802508 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1e21a9e1-8c40-4822-a172-ea03e6a1a1ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:54.852342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1e21a9e1-8c40-4822-a172-ea03e6a1a1ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:54.859541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1e21a9e1-8c40-4822-a172-ea03e6a1a1ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:54.862541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1e21a9e1-8c40-4822-a172-ea03e6a1a1ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1406 microversion: 2.20 time: 2.505966 Jul 29 11:46:54.868705 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 30/52] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:46:52 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1406 bytes in 2514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:46:55.191249 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-b2de5c94-5af3-4f76-a7f8-36f3f86c5eba req-6941c663-f53b-41a3-b4e4-48c096c018f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4", "tag": "72de6824-05b0-479e-b6e6-0a65819542dc"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:46:55.228671 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-b2de5c94-5af3-4f76-a7f8-36f3f86c5eba req-6941c663-f53b-41a3-b4e4-48c096c018f3 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:55.238245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-b2de5c94-5af3-4f76-a7f8-36f3f86c5eba req-6941c663-f53b-41a3-b4e4-48c096c018f3 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:55.272211 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-b2de5c94-5af3-4f76-a7f8-36f3f86c5eba req-6941c663-f53b-41a3-b4e4-48c096c018f3 service nova] Creating event network-changed:72de6824-05b0-479e-b6e6-0a65819542dc for instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 on hv-cinder-83754 Jul 29 11:46:55.277954 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-b2de5c94-5af3-4f76-a7f8-36f3f86c5eba req-6941c663-f53b-41a3-b4e4-48c096c018f3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129584) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 29 11:46:55.277954 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7d3ac8a9-cc6c-4ad7-98ef-87d5321a6c25 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:55.277954 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7d3ac8a9-cc6c-4ad7-98ef-87d5321a6c25 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:55.277954 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7d3ac8a9-cc6c-4ad7-98ef-87d5321a6c25 None None] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:55.277954 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7d3ac8a9-cc6c-4ad7-98ef-87d5321a6c25 None None] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:55.290370 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.compute.rpcapi [None req-7d3ac8a9-cc6c-4ad7-98ef-87d5321a6c25 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 29 11:46:55.291699 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7d3ac8a9-cc6c-4ad7-98ef-87d5321a6c25 None None] Releasing lock "compute-rpcapi-router" {{(pid=129584) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 29 11:46:55.334255 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-7d3ac8a9-cc6c-4ad7-98ef-87d5321a6c25 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.418354 Jul 29 11:46:55.335163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 31/53] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:46:55.365604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9bddc659-50df-41a5-829a-6ff68b35bb1a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:55.368853 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-9bddc659-50df-41a5-829a-6ff68b35bb1a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:55.389643 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9bddc659-50df-41a5-829a-6ff68b35bb1a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:55.400085 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9bddc659-50df-41a5-829a-6ff68b35bb1a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:55.410992 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9bddc659-50df-41a5-829a-6ff68b35bb1a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:55.411480 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9bddc659-50df-41a5-829a-6ff68b35bb1a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:55.499286 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-d6488f33-091c-4e53-91dc-861f3ad81a86 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:55.508984 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-d6488f33-091c-4e53-91dc-861f3ad81a86 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1315 microversion: 2.1 time: 1.128147 Jul 29 11:46:55.513577 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 23/54] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:54 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1315 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:55.527266 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-d97f9f79-dd6f-41ef-adfa-a812691889d6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:55.528154 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-d97f9f79-dd6f-41ef-adfa-a812691889d6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:55.543474 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d97f9f79-dd6f-41ef-adfa-a812691889d6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:55.544113 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d97f9f79-dd6f-41ef-adfa-a812691889d6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:55.545081 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d97f9f79-dd6f-41ef-adfa-a812691889d6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:55.550359 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d97f9f79-dd6f-41ef-adfa-a812691889d6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:55.832377 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-9bddc659-50df-41a5-829a-6ff68b35bb1a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:55.849053 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-d97f9f79-dd6f-41ef-adfa-a812691889d6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:55.858305 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-d97f9f79-dd6f-41ef-adfa-a812691889d6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1299 microversion: 2.1 time: 0.343445 Jul 29 11:46:55.862990 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 24/55] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:55 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1299 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:55.865470 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-9bddc659-50df-41a5-829a-6ff68b35bb1a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1280 microversion: 2.1 time: 0.527433 Jul 29 11:46:55.894674 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-89bb880c-4a72-4a2e-9cfa-6ec0484a2f8f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:55.895694 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-89bb880c-4a72-4a2e-9cfa-6ec0484a2f8f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:55.900771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 32/56] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:55 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1280 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:55.905577 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-89bb880c-4a72-4a2e-9cfa-6ec0484a2f8f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:55.906387 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-89bb880c-4a72-4a2e-9cfa-6ec0484a2f8f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:55.908188 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-89bb880c-4a72-4a2e-9cfa-6ec0484a2f8f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:55.913068 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-89bb880c-4a72-4a2e-9cfa-6ec0484a2f8f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:56.336987 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-89bb880c-4a72-4a2e-9cfa-6ec0484a2f8f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:56.345675 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-89bb880c-4a72-4a2e-9cfa-6ec0484a2f8f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:56.347374 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-89bb880c-4a72-4a2e-9cfa-6ec0484a2f8f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:56.348602 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-89bb880c-4a72-4a2e-9cfa-6ec0484a2f8f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1406 microversion: 2.20 time: 0.457787 Jul 29 11:46:56.358116 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 25/57] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:46:55 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1406 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:46:56.532450 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-7c72f470-b545-4313-a3a3-e8b4a3b719c8 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:56.533325 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-7c72f470-b545-4313-a3a3-e8b4a3b719c8 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:56.542660 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7c72f470-b545-4313-a3a3-e8b4a3b719c8 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:56.548463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7c72f470-b545-4313-a3a3-e8b4a3b719c8 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:56.549598 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7c72f470-b545-4313-a3a3-e8b4a3b719c8 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:56.550050 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7c72f470-b545-4313-a3a3-e8b4a3b719c8 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:56.889941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-01fae4da-c50e-48ae-a8f9-8a96615889c4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:56.891202 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-01fae4da-c50e-48ae-a8f9-8a96615889c4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:56.905364 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-01fae4da-c50e-48ae-a8f9-8a96615889c4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:56.905864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-01fae4da-c50e-48ae-a8f9-8a96615889c4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:56.909186 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-01fae4da-c50e-48ae-a8f9-8a96615889c4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:56.913579 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-01fae4da-c50e-48ae-a8f9-8a96615889c4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:57.433568 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-01fae4da-c50e-48ae-a8f9-8a96615889c4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:57.453912 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-01fae4da-c50e-48ae-a8f9-8a96615889c4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1299 microversion: 2.1 time: 0.560575 Jul 29 11:46:57.470591 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 26/58] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:56 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1299 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:57.493876 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5262dd01-3098-4ed9-b62f-9eb637b46874 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:57.494846 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-5262dd01-3098-4ed9-b62f-9eb637b46874 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:57.518452 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5262dd01-3098-4ed9-b62f-9eb637b46874 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:57.518915 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5262dd01-3098-4ed9-b62f-9eb637b46874 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:57.536654 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5262dd01-3098-4ed9-b62f-9eb637b46874 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:57.537248 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5262dd01-3098-4ed9-b62f-9eb637b46874 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:57.625520 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-7c72f470-b545-4313-a3a3-e8b4a3b719c8 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:57.646337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-7c72f470-b545-4313-a3a3-e8b4a3b719c8 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1315 microversion: 2.1 time: 1.115362 Jul 29 11:46:57.650138 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 33/59] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:56 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1315 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:46:57.660004 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-8260a008-778f-4eae-98b5-8e1863548340 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:57.664780 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-8260a008-778f-4eae-98b5-8e1863548340 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:57.682282 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8260a008-778f-4eae-98b5-8e1863548340 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:57.683123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8260a008-778f-4eae-98b5-8e1863548340 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:57.684974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8260a008-778f-4eae-98b5-8e1863548340 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:57.686619 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8260a008-778f-4eae-98b5-8e1863548340 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:58.249876 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-8260a008-778f-4eae-98b5-8e1863548340 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:58.251615 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-5262dd01-3098-4ed9-b62f-9eb637b46874 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:58.267243 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-8260a008-778f-4eae-98b5-8e1863548340 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:58.269098 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-8260a008-778f-4eae-98b5-8e1863548340 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:58.270587 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-8260a008-778f-4eae-98b5-8e1863548340 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1406 microversion: 2.20 time: 0.619193 Jul 29 11:46:58.281449 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-5262dd01-3098-4ed9-b62f-9eb637b46874 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1322 microversion: 2.1 time: 0.804938 Jul 29 11:46:58.282035 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 34/60] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:46:57 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1406 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:46:58.283277 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 27/61] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:57 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1322 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:58.295755 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-1353b41b-f07f-4469-899b-f63b70fe2af3 req-0d8e0707-57f5-417a-8fd1-d426d1e005cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e39f512-b616-4e06-9f81-f853454d67aa", "tag": "a089bb79-5e40-4138-a8cf-26b1b99b5535"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:46:58.314825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-1353b41b-f07f-4469-899b-f63b70fe2af3 req-0d8e0707-57f5-417a-8fd1-d426d1e005cd service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:58.315421 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-1353b41b-f07f-4469-899b-f63b70fe2af3 req-0d8e0707-57f5-417a-8fd1-d426d1e005cd service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:58.336133 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-1353b41b-f07f-4469-899b-f63b70fe2af3 req-0d8e0707-57f5-417a-8fd1-d426d1e005cd service nova] Creating event network-changed:a089bb79-5e40-4138-a8cf-26b1b99b5535 for instance 8e39f512-b616-4e06-9f81-f853454d67aa on hv-cinder-83754 Jul 29 11:46:58.355421 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-1353b41b-f07f-4469-899b-f63b70fe2af3 req-0d8e0707-57f5-417a-8fd1-d426d1e005cd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071821 Jul 29 11:46:58.356141 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 35/62] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:46:58.481690 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ce9f95a7-788f-4daa-ac82-fa622ab27459 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:58.483107 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ce9f95a7-788f-4daa-ac82-fa622ab27459 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:58.503108 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=6 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:58.511737 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:58.525434 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ce9f95a7-788f-4daa-ac82-fa622ab27459 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:58.528920 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ce9f95a7-788f-4daa-ac82-fa622ab27459 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:58.531642 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ce9f95a7-788f-4daa-ac82-fa622ab27459 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:58.547873 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ce9f95a7-788f-4daa-ac82-fa622ab27459 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:58.583460 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=63 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:58.668178 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=24 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:58.672375 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-02c3d533-98c6-4076-acb8-85922d7a8bf3 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:58.673088 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-02c3d533-98c6-4076-acb8-85922d7a8bf3 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:58.688233 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:58.689959 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-02c3d533-98c6-4076-acb8-85922d7a8bf3 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:58.690411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-02c3d533-98c6-4076-acb8-85922d7a8bf3 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:58.691207 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-02c3d533-98c6-4076-acb8-85922d7a8bf3 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:58.691644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-02c3d533-98c6-4076-acb8-85922d7a8bf3 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:58.719761 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ce9f95a7-788f-4daa-ac82-fa622ab27459 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:58.734069 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ce9f95a7-788f-4daa-ac82-fa622ab27459 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1299 microversion: 2.1 time: 0.260309 Jul 29 11:46:58.752059 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 28/63] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:58 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1299 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:59.023033 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-02c3d533-98c6-4076-acb8-85922d7a8bf3 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:59.037447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-02c3d533-98c6-4076-acb8-85922d7a8bf3 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1315 microversion: 2.1 time: 0.370164 Jul 29 11:46:59.040628 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 36/64] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:58 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:46:59.296388 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-138a9ef7-2b6c-4655-893d-2dcba002b002 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:59.297243 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-138a9ef7-2b6c-4655-893d-2dcba002b002 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:59.306944 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-138a9ef7-2b6c-4655-893d-2dcba002b002 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:59.309734 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-138a9ef7-2b6c-4655-893d-2dcba002b002 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:59.310706 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-138a9ef7-2b6c-4655-893d-2dcba002b002 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:59.313114 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-138a9ef7-2b6c-4655-893d-2dcba002b002 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:59.567423 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=26 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:46:59.654305 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-138a9ef7-2b6c-4655-893d-2dcba002b002 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:59.671197 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-138a9ef7-2b6c-4655-893d-2dcba002b002 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:59.678369 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-138a9ef7-2b6c-4655-893d-2dcba002b002 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:46:59.682108 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-138a9ef7-2b6c-4655-893d-2dcba002b002 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1406 microversion: 2.20 time: 0.390162 Jul 29 11:46:59.695853 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 37/65] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:46:59 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1406 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:46:59.712098 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5da4651d-2630-4fe6-962f-5897752afb5f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:46:59.713062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-5da4651d-2630-4fe6-962f-5897752afb5f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:46:59.722161 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5da4651d-2630-4fe6-962f-5897752afb5f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:59.727086 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5da4651d-2630-4fe6-962f-5897752afb5f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:59.728997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5da4651d-2630-4fe6-962f-5897752afb5f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:59.730224 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5da4651d-2630-4fe6-962f-5897752afb5f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:46:59.935828 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-cbc3c4de-0b93-4e59-8d65-e95f0b880111 req-8c08ef0f-ffae-4787-9caf-81d8779f37e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7bd0b02-2726-4432-a6a1-53035c9a1978", "tag": "fb1642b2-a468-43c6-8233-7e7bcc25cfcd"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:46:59.982560 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-cbc3c4de-0b93-4e59-8d65-e95f0b880111 req-8c08ef0f-ffae-4787-9caf-81d8779f37e0 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:46:59.983026 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-cbc3c4de-0b93-4e59-8d65-e95f0b880111 req-8c08ef0f-ffae-4787-9caf-81d8779f37e0 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:00.061352 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-cbc3c4de-0b93-4e59-8d65-e95f0b880111 req-8c08ef0f-ffae-4787-9caf-81d8779f37e0 service nova] Creating event network-changed:fb1642b2-a468-43c6-8233-7e7bcc25cfcd for instance d7bd0b02-2726-4432-a6a1-53035c9a1978 on hv-cinder-83754 Jul 29 11:47:00.061956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-cbc3c4de-0b93-4e59-8d65-e95f0b880111 req-8c08ef0f-ffae-4787-9caf-81d8779f37e0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 29 11:47:00.063068 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-655624c7-b82a-4e89-83aa-9469e38705fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:00.063513 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-655624c7-b82a-4e89-83aa-9469e38705fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:00.064294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-655624c7-b82a-4e89-83aa-9469e38705fe None None] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:00.064727 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-655624c7-b82a-4e89-83aa-9469e38705fe None None] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:00.078791 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.compute.rpcapi [None req-655624c7-b82a-4e89-83aa-9469e38705fe None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 29 11:47:00.079799 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-655624c7-b82a-4e89-83aa-9469e38705fe None None] Releasing lock "compute-rpcapi-router" {{(pid=129585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 29 11:47:00.130262 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-655624c7-b82a-4e89-83aa-9469e38705fe None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.100991 Jul 29 11:47:00.130957 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 29/66] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:47:00.137834 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9d98034d-7708-44d9-817e-1511f27ecf36 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:00.140164 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9d98034d-7708-44d9-817e-1511f27ecf36 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:00.156771 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d98034d-7708-44d9-817e-1511f27ecf36 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:00.158373 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d98034d-7708-44d9-817e-1511f27ecf36 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:00.160038 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d98034d-7708-44d9-817e-1511f27ecf36 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:00.162750 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d98034d-7708-44d9-817e-1511f27ecf36 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:00.191572 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5da4651d-2630-4fe6-962f-5897752afb5f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:00.202689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-5da4651d-2630-4fe6-962f-5897752afb5f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1322 microversion: 2.1 time: 0.502799 Jul 29 11:47:00.203822 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 38/67] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:46:59 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:00.217489 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d09c4629-e0b4-4e77-b3be-8f6f915144e2 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:00.217843 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d09c4629-e0b4-4e77-b3be-8f6f915144e2 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:00.227977 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d09c4629-e0b4-4e77-b3be-8f6f915144e2 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:00.228381 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d09c4629-e0b4-4e77-b3be-8f6f915144e2 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:00.236363 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d09c4629-e0b4-4e77-b3be-8f6f915144e2 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:00.237007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d09c4629-e0b4-4e77-b3be-8f6f915144e2 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:00.412541 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9d98034d-7708-44d9-817e-1511f27ecf36 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:00.423400 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9d98034d-7708-44d9-817e-1511f27ecf36 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1366 microversion: 2.1 time: 0.291192 Jul 29 11:47:00.424094 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 30/68] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:00 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:00.502655 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d09c4629-e0b4-4e77-b3be-8f6f915144e2 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:00.515213 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d09c4629-e0b4-4e77-b3be-8f6f915144e2 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1315 microversion: 2.1 time: 0.309106 Jul 29 11:47:00.518410 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 39/69] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:00 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:00.716095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-cb000d74-68a1-49f7-b07f-8f9c90748179 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:00.716713 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-cb000d74-68a1-49f7-b07f-8f9c90748179 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:00.728245 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cb000d74-68a1-49f7-b07f-8f9c90748179 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:00.728245 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cb000d74-68a1-49f7-b07f-8f9c90748179 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:00.734003 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cb000d74-68a1-49f7-b07f-8f9c90748179 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:00.734417 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cb000d74-68a1-49f7-b07f-8f9c90748179 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:01.226897 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6f508178-89ca-4870-886b-857cf89685a5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:01.228162 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6f508178-89ca-4870-886b-857cf89685a5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:01.240155 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6f508178-89ca-4870-886b-857cf89685a5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:01.240663 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6f508178-89ca-4870-886b-857cf89685a5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:01.241502 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6f508178-89ca-4870-886b-857cf89685a5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:01.241946 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6f508178-89ca-4870-886b-857cf89685a5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:01.877648 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-cb000d74-68a1-49f7-b07f-8f9c90748179 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:01.900676 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-cb000d74-68a1-49f7-b07f-8f9c90748179 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:01.902795 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-cb000d74-68a1-49f7-b07f-8f9c90748179 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:01.913699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-cb000d74-68a1-49f7-b07f-8f9c90748179 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1406 microversion: 2.20 time: 1.192453 Jul 29 11:47:01.914622 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 31/70] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:47:00 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1406 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:47:01.919707 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-1840616d-6e93-453a-9d12-09d173166ede tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:01.920322 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-1840616d-6e93-453a-9d12-09d173166ede tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:01.947389 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1840616d-6e93-453a-9d12-09d173166ede tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:01.947751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1840616d-6e93-453a-9d12-09d173166ede tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:01.949241 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1840616d-6e93-453a-9d12-09d173166ede tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:01.949702 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1840616d-6e93-453a-9d12-09d173166ede tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:02.311278 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6f508178-89ca-4870-886b-857cf89685a5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:02.316462 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=100 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:02.329307 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-6f508178-89ca-4870-886b-857cf89685a5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1322 microversion: 2.1 time: 1.107595 Jul 29 11:47:02.333992 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 40/71] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:01 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1322 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:02.346306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-57cc768b-dd07-4970-af0a-91e3253e9d62 req-b0780ac6-5fc3-4431-a771-fd5e23b7862f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c8a2d21-648a-4b70-badd-2d7e499f5b90", "tag": "37549cbf-4d66-48e6-b4f4-c12905ec4351"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:47:02.373726 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-57cc768b-dd07-4970-af0a-91e3253e9d62 req-b0780ac6-5fc3-4431-a771-fd5e23b7862f service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:02.374180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-57cc768b-dd07-4970-af0a-91e3253e9d62 req-b0780ac6-5fc3-4431-a771-fd5e23b7862f service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:02.403590 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-57cc768b-dd07-4970-af0a-91e3253e9d62 req-b0780ac6-5fc3-4431-a771-fd5e23b7862f service nova] Creating event network-changed:37549cbf-4d66-48e6-b4f4-c12905ec4351 for instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 on hv-cinder-83754 Jul 29 11:47:02.415053 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-57cc768b-dd07-4970-af0a-91e3253e9d62 req-b0780ac6-5fc3-4431-a771-fd5e23b7862f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078739 Jul 29 11:47:02.418970 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 41/72] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:47:02.434925 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f68ab639-9871-4bea-8e9b-c21e8ff8a1fe tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:02.436214 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f68ab639-9871-4bea-8e9b-c21e8ff8a1fe tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:02.457213 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f68ab639-9871-4bea-8e9b-c21e8ff8a1fe tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:02.458282 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f68ab639-9871-4bea-8e9b-c21e8ff8a1fe tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:02.460395 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f68ab639-9871-4bea-8e9b-c21e8ff8a1fe tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:02.461944 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f68ab639-9871-4bea-8e9b-c21e8ff8a1fe tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:02.542784 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-1840616d-6e93-453a-9d12-09d173166ede tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:02.551201 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-1840616d-6e93-453a-9d12-09d173166ede tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1366 microversion: 2.1 time: 0.635385 Jul 29 11:47:02.551826 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 32/73] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:01 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1366 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:02.556172 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-5e7cdf14-090e-4ea6-a227-568a2d424a80 req-9a3a7a40-b4b1-406b-83f8-90d3d630c73c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600bd88b-d9ed-4efe-a4fe-5ae8a93497c9", "tag": "c7dcc6c9-56c0-4221-a382-4dc2c7a538eb"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:47:02.594598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-5e7cdf14-090e-4ea6-a227-568a2d424a80 req-9a3a7a40-b4b1-406b-83f8-90d3d630c73c service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:02.596533 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-5e7cdf14-090e-4ea6-a227-568a2d424a80 req-9a3a7a40-b4b1-406b-83f8-90d3d630c73c service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:02.623779 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-5e7cdf14-090e-4ea6-a227-568a2d424a80 req-9a3a7a40-b4b1-406b-83f8-90d3d630c73c service nova] Creating event network-changed:c7dcc6c9-56c0-4221-a382-4dc2c7a538eb for instance 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 on hv-cinder-83754 Jul 29 11:47:02.633061 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-5e7cdf14-090e-4ea6-a227-568a2d424a80 req-9a3a7a40-b4b1-406b-83f8-90d3d630c73c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080090 Jul 29 11:47:02.634777 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 33/74] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:47:02.743636 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f68ab639-9871-4bea-8e9b-c21e8ff8a1fe tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:02.752824 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f68ab639-9871-4bea-8e9b-c21e8ff8a1fe tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1315 microversion: 2.1 time: 0.330990 Jul 29 11:47:02.753725 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 42/75] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:02 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:02.937599 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-003193f1-b7c9-4363-bc3f-9648a2e12a04 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:02.939061 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-003193f1-b7c9-4363-bc3f-9648a2e12a04 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:02.945673 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-003193f1-b7c9-4363-bc3f-9648a2e12a04 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:02.946346 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-003193f1-b7c9-4363-bc3f-9648a2e12a04 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:02.947366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-003193f1-b7c9-4363-bc3f-9648a2e12a04 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:02.947990 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-003193f1-b7c9-4363-bc3f-9648a2e12a04 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:03.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-003193f1-b7c9-4363-bc3f-9648a2e12a04 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:03.116414 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-003193f1-b7c9-4363-bc3f-9648a2e12a04 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:03.117993 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-003193f1-b7c9-4363-bc3f-9648a2e12a04 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:03.119116 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-003193f1-b7c9-4363-bc3f-9648a2e12a04 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1406 microversion: 2.20 time: 0.185745 Jul 29 11:47:03.119698 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 34/76] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:47:02 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:47:03.356864 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-95f5eba9-191d-4c1b-b546-b466eff669c3 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:03.357911 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-95f5eba9-191d-4c1b-b546-b466eff669c3 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:03.369408 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-95f5eba9-191d-4c1b-b546-b466eff669c3 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:03.369814 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-95f5eba9-191d-4c1b-b546-b466eff669c3 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:03.377816 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-95f5eba9-191d-4c1b-b546-b466eff669c3 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:03.378300 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-95f5eba9-191d-4c1b-b546-b466eff669c3 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:03.562647 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-95f5eba9-191d-4c1b-b546-b466eff669c3 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:03.571730 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-88a5745a-9102-4fa1-a819-12076d605cf3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:03.573014 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-88a5745a-9102-4fa1-a819-12076d605cf3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:03.573130 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-95f5eba9-191d-4c1b-b546-b466eff669c3 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1322 microversion: 2.1 time: 0.222595 Jul 29 11:47:03.586005 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 43/77] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:03 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:03.598905 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-88a5745a-9102-4fa1-a819-12076d605cf3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:03.599678 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-88a5745a-9102-4fa1-a819-12076d605cf3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:03.600626 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-88a5745a-9102-4fa1-a819-12076d605cf3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:03.601235 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-88a5745a-9102-4fa1-a819-12076d605cf3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:03.774014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ef79749b-7de1-4e48-96c6-c53ec84651a8 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:03.775029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ef79749b-7de1-4e48-96c6-c53ec84651a8 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:03.789175 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ef79749b-7de1-4e48-96c6-c53ec84651a8 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:03.792626 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ef79749b-7de1-4e48-96c6-c53ec84651a8 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:03.793707 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ef79749b-7de1-4e48-96c6-c53ec84651a8 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:03.798051 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ef79749b-7de1-4e48-96c6-c53ec84651a8 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:03.858738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-88a5745a-9102-4fa1-a819-12076d605cf3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:03.873309 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-88a5745a-9102-4fa1-a819-12076d605cf3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1366 microversion: 2.1 time: 0.303425 Jul 29 11:47:03.876584 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 35/78] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:03 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:04.060949 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ef79749b-7de1-4e48-96c6-c53ec84651a8 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:04.070169 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ef79749b-7de1-4e48-96c6-c53ec84651a8 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1315 microversion: 2.1 time: 0.299843 Jul 29 11:47:04.082995 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 44/79] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:03 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:47:04.145500 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e34ce996-de00-4391-88fd-799574e9c6f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:04.146464 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e34ce996-de00-4391-88fd-799574e9c6f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:04.163065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e34ce996-de00-4391-88fd-799574e9c6f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:04.164795 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e34ce996-de00-4391-88fd-799574e9c6f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:04.169230 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e34ce996-de00-4391-88fd-799574e9c6f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:04.170409 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e34ce996-de00-4391-88fd-799574e9c6f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:04.432927 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e34ce996-de00-4391-88fd-799574e9c6f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:04.442799 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e34ce996-de00-4391-88fd-799574e9c6f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:04.444744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e34ce996-de00-4391-88fd-799574e9c6f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:04.446594 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e34ce996-de00-4391-88fd-799574e9c6f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1406 microversion: 2.20 time: 0.306191 Jul 29 11:47:04.470518 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 36/80] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:47:04 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:47:04.599934 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-aebf0828-6dd4-446f-8a16-fc52de9dcc3a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:04.601161 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-aebf0828-6dd4-446f-8a16-fc52de9dcc3a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:04.618706 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aebf0828-6dd4-446f-8a16-fc52de9dcc3a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:04.620491 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aebf0828-6dd4-446f-8a16-fc52de9dcc3a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:04.626724 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aebf0828-6dd4-446f-8a16-fc52de9dcc3a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:04.630451 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aebf0828-6dd4-446f-8a16-fc52de9dcc3a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:04.733054 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-5f02ef5c-43ba-4243-9462-f066fe6c9425 req-866f16bc-9c8b-434b-adac-197c251e1da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4", "name": "network-vif-plugged", "status": "completed", "tag": "72de6824-05b0-479e-b6e6-0a65819542dc"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:47:04.753019 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-5f02ef5c-43ba-4243-9462-f066fe6c9425 req-866f16bc-9c8b-434b-adac-197c251e1da4 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:04.756099 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-5f02ef5c-43ba-4243-9462-f066fe6c9425 req-866f16bc-9c8b-434b-adac-197c251e1da4 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:04.786107 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-5f02ef5c-43ba-4243-9462-f066fe6c9425 req-866f16bc-9c8b-434b-adac-197c251e1da4 service nova] Creating event network-vif-plugged:72de6824-05b0-479e-b6e6-0a65819542dc for instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 on hv-cinder-83754 Jul 29 11:47:04.789455 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-aebf0828-6dd4-446f-8a16-fc52de9dcc3a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:04.799734 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-aebf0828-6dd4-446f-8a16-fc52de9dcc3a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1322 microversion: 2.1 time: 0.205003 Jul 29 11:47:04.800626 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 45/81] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:04 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:04.800930 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-5f02ef5c-43ba-4243-9462-f066fe6c9425 req-866f16bc-9c8b-434b-adac-197c251e1da4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202385 Jul 29 11:47:04.801567 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 37/82] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:47:04.905125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5497f986-c2d2-4d42-aa33-831d905a6912 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:04.906494 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-5497f986-c2d2-4d42-aa33-831d905a6912 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:04.915377 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5497f986-c2d2-4d42-aa33-831d905a6912 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:04.916299 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5497f986-c2d2-4d42-aa33-831d905a6912 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:04.918294 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5497f986-c2d2-4d42-aa33-831d905a6912 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:04.919292 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5497f986-c2d2-4d42-aa33-831d905a6912 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:05.096188 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-470998ef-caed-4c6c-8bd7-5b5e71a226ca tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:05.097211 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-470998ef-caed-4c6c-8bd7-5b5e71a226ca tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:05.104717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-470998ef-caed-4c6c-8bd7-5b5e71a226ca tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:05.105347 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-470998ef-caed-4c6c-8bd7-5b5e71a226ca tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:05.106356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-470998ef-caed-4c6c-8bd7-5b5e71a226ca tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:05.107010 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-470998ef-caed-4c6c-8bd7-5b5e71a226ca tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:05.295184 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=6 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:05.372930 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5497f986-c2d2-4d42-aa33-831d905a6912 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:05.383330 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-5497f986-c2d2-4d42-aa33-831d905a6912 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1366 microversion: 2.1 time: 0.490817 Jul 29 11:47:05.387420 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 46/83] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:04 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1366 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:47:05.474030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b7dee7fa-acec-4133-a82a-458f6a9f9833 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:05.475051 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b7dee7fa-acec-4133-a82a-458f6a9f9833 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:05.490925 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b7dee7fa-acec-4133-a82a-458f6a9f9833 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:05.492848 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b7dee7fa-acec-4133-a82a-458f6a9f9833 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:05.493849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b7dee7fa-acec-4133-a82a-458f6a9f9833 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:05.499108 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b7dee7fa-acec-4133-a82a-458f6a9f9833 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:05.741863 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-470998ef-caed-4c6c-8bd7-5b5e71a226ca tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:05.750343 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-470998ef-caed-4c6c-8bd7-5b5e71a226ca tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1315 microversion: 2.1 time: 0.658231 Jul 29 11:47:05.753757 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 38/84] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:05 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:05.822799 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-7647e36d-d279-4907-922d-68e8a8ee10c0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:05.823714 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-7647e36d-d279-4907-922d-68e8a8ee10c0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:05.835870 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7647e36d-d279-4907-922d-68e8a8ee10c0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:05.843756 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7647e36d-d279-4907-922d-68e8a8ee10c0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:05.845077 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7647e36d-d279-4907-922d-68e8a8ee10c0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:05.854894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7647e36d-d279-4907-922d-68e8a8ee10c0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:06.383615 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b7dee7fa-acec-4133-a82a-458f6a9f9833 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:06.397694 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b7dee7fa-acec-4133-a82a-458f6a9f9833 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:06.399283 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b7dee7fa-acec-4133-a82a-458f6a9f9833 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:06.400411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b7dee7fa-acec-4133-a82a-458f6a9f9833 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1406 microversion: 2.20 time: 0.930496 Jul 29 11:47:06.401121 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 47/85] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:47:05 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1406 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:47:06.426238 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b1c19102-17f5-4161-b69d-b57692cc703e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:06.427017 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b1c19102-17f5-4161-b69d-b57692cc703e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:06.434603 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b1c19102-17f5-4161-b69d-b57692cc703e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:06.435247 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b1c19102-17f5-4161-b69d-b57692cc703e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:06.436165 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b1c19102-17f5-4161-b69d-b57692cc703e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:06.436780 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b1c19102-17f5-4161-b69d-b57692cc703e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:06.853407 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-7647e36d-d279-4907-922d-68e8a8ee10c0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:06.862675 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-7647e36d-d279-4907-922d-68e8a8ee10c0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1322 microversion: 2.1 time: 1.044023 Jul 29 11:47:06.866005 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 39/86] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:05 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1322 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:06.871269 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-12ce1f4d-c9f5-4b93-913e-5a874970fe19 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:06.872084 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-12ce1f4d-c9f5-4b93-913e-5a874970fe19 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:06.882357 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-12ce1f4d-c9f5-4b93-913e-5a874970fe19 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:06.883098 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-12ce1f4d-c9f5-4b93-913e-5a874970fe19 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:06.884096 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-12ce1f4d-c9f5-4b93-913e-5a874970fe19 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:06.884480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-12ce1f4d-c9f5-4b93-913e-5a874970fe19 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:06.921082 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b1c19102-17f5-4161-b69d-b57692cc703e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:06.932439 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b1c19102-17f5-4161-b69d-b57692cc703e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1366 microversion: 2.1 time: 0.512338 Jul 29 11:47:06.942120 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 48/87] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:06 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1366 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:06.942120 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-3f9e9883-3f30-4821-9422-0ec0fb1f431c req-397729a7-aac0-4e19-a6d9-cd379fd5d102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e39f512-b616-4e06-9f81-f853454d67aa", "name": "network-vif-plugged", "status": "completed", "tag": "a089bb79-5e40-4138-a8cf-26b1b99b5535"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:47:06.952356 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-3f9e9883-3f30-4821-9422-0ec0fb1f431c req-397729a7-aac0-4e19-a6d9-cd379fd5d102 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:06.952998 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-3f9e9883-3f30-4821-9422-0ec0fb1f431c req-397729a7-aac0-4e19-a6d9-cd379fd5d102 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:06.971250 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-3f9e9883-3f30-4821-9422-0ec0fb1f431c req-397729a7-aac0-4e19-a6d9-cd379fd5d102 service nova] Creating event network-vif-plugged:a089bb79-5e40-4138-a8cf-26b1b99b5535 for instance 8e39f512-b616-4e06-9f81-f853454d67aa on hv-cinder-83754 Jul 29 11:47:06.977845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-3f9e9883-3f30-4821-9422-0ec0fb1f431c req-397729a7-aac0-4e19-a6d9-cd379fd5d102 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041969 Jul 29 11:47:06.979182 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 49/88] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:47:07.217603 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-12ce1f4d-c9f5-4b93-913e-5a874970fe19 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:07.230482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-12ce1f4d-c9f5-4b93-913e-5a874970fe19 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1315 microversion: 2.1 time: 0.361740 Jul 29 11:47:07.232051 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 40/89] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:06 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:07.426528 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e969d57a-afbc-499a-94af-abcfeb8fd9bb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:07.427239 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e969d57a-afbc-499a-94af-abcfeb8fd9bb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:07.439095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e969d57a-afbc-499a-94af-abcfeb8fd9bb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:07.439966 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e969d57a-afbc-499a-94af-abcfeb8fd9bb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:07.440786 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e969d57a-afbc-499a-94af-abcfeb8fd9bb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:07.441224 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e969d57a-afbc-499a-94af-abcfeb8fd9bb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:07.728444 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e969d57a-afbc-499a-94af-abcfeb8fd9bb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:07.740728 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e969d57a-afbc-499a-94af-abcfeb8fd9bb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:07.742767 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e969d57a-afbc-499a-94af-abcfeb8fd9bb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:07.744853 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e969d57a-afbc-499a-94af-abcfeb8fd9bb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1406 microversion: 2.20 time: 0.322847 Jul 29 11:47:07.758057 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 50/90] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:47:07 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:47:07.884262 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8b174217-a22c-486b-903d-bcd10808c920 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:07.884909 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8b174217-a22c-486b-903d-bcd10808c920 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:07.891724 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8b174217-a22c-486b-903d-bcd10808c920 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:07.892462 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8b174217-a22c-486b-903d-bcd10808c920 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:07.893453 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8b174217-a22c-486b-903d-bcd10808c920 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:07.894114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8b174217-a22c-486b-903d-bcd10808c920 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:07.956881 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-a92841e8-3cd0-4d41-992f-e94f5f3f5232 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:07.958205 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-a92841e8-3cd0-4d41-992f-e94f5f3f5232 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:07.966422 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a92841e8-3cd0-4d41-992f-e94f5f3f5232 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:07.967055 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a92841e8-3cd0-4d41-992f-e94f5f3f5232 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:07.967943 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a92841e8-3cd0-4d41-992f-e94f5f3f5232 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:07.968459 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a92841e8-3cd0-4d41-992f-e94f5f3f5232 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:08.154187 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-8b174217-a22c-486b-903d-bcd10808c920 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:08.166494 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8b174217-a22c-486b-903d-bcd10808c920 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1322 microversion: 2.1 time: 0.285776 Jul 29 11:47:08.168933 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 41/91] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:07 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:08.174464 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a92841e8-3cd0-4d41-992f-e94f5f3f5232 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:08.185991 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-a92841e8-3cd0-4d41-992f-e94f5f3f5232 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1366 microversion: 2.1 time: 0.234523 Jul 29 11:47:08.186888 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 51/92] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:07 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:08.256764 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-38a08738-faa9-45d7-9e76-b251229ce3fb tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:08.257387 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-38a08738-faa9-45d7-9e76-b251229ce3fb tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:08.264683 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-38a08738-faa9-45d7-9e76-b251229ce3fb tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:08.265766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-38a08738-faa9-45d7-9e76-b251229ce3fb tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:08.266552 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-38a08738-faa9-45d7-9e76-b251229ce3fb tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:08.267008 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-38a08738-faa9-45d7-9e76-b251229ce3fb tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:08.412929 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-38a08738-faa9-45d7-9e76-b251229ce3fb tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:08.422277 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-38a08738-faa9-45d7-9e76-b251229ce3fb tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1502 microversion: 2.1 time: 0.169187 Jul 29 11:47:08.437796 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 42/93] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:08 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:08.769761 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-8fe853a7-5202-4808-ae90-21dfa5e85364 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:08.770555 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-8fe853a7-5202-4808-ae90-21dfa5e85364 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:08.789705 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8fe853a7-5202-4808-ae90-21dfa5e85364 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:08.792830 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8fe853a7-5202-4808-ae90-21dfa5e85364 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:08.796954 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8fe853a7-5202-4808-ae90-21dfa5e85364 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:08.798631 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8fe853a7-5202-4808-ae90-21dfa5e85364 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:09.117671 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-8fe853a7-5202-4808-ae90-21dfa5e85364 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:09.132392 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-8fe853a7-5202-4808-ae90-21dfa5e85364 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:09.134226 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-8fe853a7-5202-4808-ae90-21dfa5e85364 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:09.141708 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-8fe853a7-5202-4808-ae90-21dfa5e85364 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1406 microversion: 2.20 time: 0.375220 Jul 29 11:47:09.142558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 52/94] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:47:08 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1406 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:47:09.193647 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-cff3f28c-c266-44da-b529-43e8df63da84 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:09.195456 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-cff3f28c-c266-44da-b529-43e8df63da84 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:09.209770 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c36d16a0-f793-4a81-9319-e4d4fbb0be02 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:09.210658 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c36d16a0-f793-4a81-9319-e4d4fbb0be02 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:09.213887 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cff3f28c-c266-44da-b529-43e8df63da84 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:09.214345 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cff3f28c-c266-44da-b529-43e8df63da84 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:09.215127 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cff3f28c-c266-44da-b529-43e8df63da84 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:09.215561 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cff3f28c-c266-44da-b529-43e8df63da84 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:09.221815 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c36d16a0-f793-4a81-9319-e4d4fbb0be02 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:09.222733 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c36d16a0-f793-4a81-9319-e4d4fbb0be02 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:09.223713 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c36d16a0-f793-4a81-9319-e4d4fbb0be02 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:09.224345 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c36d16a0-f793-4a81-9319-e4d4fbb0be02 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:09.471286 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c36d16a0-f793-4a81-9319-e4d4fbb0be02 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:09.481798 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c36d16a0-f793-4a81-9319-e4d4fbb0be02 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1366 microversion: 2.1 time: 0.275498 Jul 29 11:47:09.493437 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 53/95] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:09 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:47:09.531106 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-cff3f28c-c266-44da-b529-43e8df63da84 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:09.540533 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-cff3f28c-c266-44da-b529-43e8df63da84 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1322 microversion: 2.1 time: 0.355357 Jul 29 11:47:09.554117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 43/96] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:09 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:09.957751 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f661a3df-15d2-473e-9d9a-d884979959cc tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f7908ef-c489-4e8f-b7f8-3982c8709b9b"}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:47:09.960224 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f661a3df-15d2-473e-9d9a-d884979959cc tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:09.966638 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f661a3df-15d2-473e-9d9a-d884979959cc tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:09.967090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f661a3df-15d2-473e-9d9a-d884979959cc tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:09.968320 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f661a3df-15d2-473e-9d9a-d884979959cc tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:09.968907 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f661a3df-15d2-473e-9d9a-d884979959cc tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:09.985940 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-0c79325d-5f64-4c0a-ad68-a8bc7b1b890c req-814d83c6-1fb7-4651-a61a-feab0081cad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7bd0b02-2726-4432-a6a1-53035c9a1978", "name": "network-vif-plugged", "status": "completed", "tag": "fb1642b2-a468-43c6-8233-7e7bcc25cfcd"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:47:09.999660 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-0c79325d-5f64-4c0a-ad68-a8bc7b1b890c req-814d83c6-1fb7-4651-a61a-feab0081cad5 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:10.000600 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-0c79325d-5f64-4c0a-ad68-a8bc7b1b890c req-814d83c6-1fb7-4651-a61a-feab0081cad5 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:10.016117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-0c79325d-5f64-4c0a-ad68-a8bc7b1b890c req-814d83c6-1fb7-4651-a61a-feab0081cad5 service nova] Creating event network-vif-plugged:fb1642b2-a468-43c6-8233-7e7bcc25cfcd for instance d7bd0b02-2726-4432-a6a1-53035c9a1978 on hv-cinder-83754 Jul 29 11:47:10.021909 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-0c79325d-5f64-4c0a-ad68-a8bc7b1b890c req-814d83c6-1fb7-4651-a61a-feab0081cad5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058992 Jul 29 11:47:10.023324 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 44/97] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:47:10.165716 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:10.174741 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-800680ac-2aa6-424c-9c07-c5cd1eda66d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:10.177282 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-800680ac-2aa6-424c-9c07-c5cd1eda66d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:10.190716 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-800680ac-2aa6-424c-9c07-c5cd1eda66d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:10.191399 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-800680ac-2aa6-424c-9c07-c5cd1eda66d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:10.192368 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-800680ac-2aa6-424c-9c07-c5cd1eda66d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:10.195873 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-800680ac-2aa6-424c-9c07-c5cd1eda66d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:10.466872 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f661a3df-15d2-473e-9d9a-d884979959cc tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "POST /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513366 Jul 29 11:47:10.468714 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 54/98] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Jul 29 11:47:09 2022] POST /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4/os-volume_attachments => generated 194 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:47:10.482794 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-800680ac-2aa6-424c-9c07-c5cd1eda66d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:10.504253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-12713449-c88e-45d9-a674-0b5e9e72002d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:10.509088 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-800680ac-2aa6-424c-9c07-c5cd1eda66d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:10.511568 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-12713449-c88e-45d9-a674-0b5e9e72002d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:10.520781 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-800680ac-2aa6-424c-9c07-c5cd1eda66d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:10.524799 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-800680ac-2aa6-424c-9c07-c5cd1eda66d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1406 microversion: 2.20 time: 0.360470 Jul 29 11:47:10.540238 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 45/99] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:47:10 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1406 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:47:10.540689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-12713449-c88e-45d9-a674-0b5e9e72002d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:10.540689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-12713449-c88e-45d9-a674-0b5e9e72002d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:10.540689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-12713449-c88e-45d9-a674-0b5e9e72002d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:10.540689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-12713449-c88e-45d9-a674-0b5e9e72002d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:10.562619 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-41875233-333b-4350-8fbe-da1bdcb0a249 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:10.563333 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-41875233-333b-4350-8fbe-da1bdcb0a249 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:10.595681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-41875233-333b-4350-8fbe-da1bdcb0a249 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:10.596302 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-41875233-333b-4350-8fbe-da1bdcb0a249 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:10.597235 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-41875233-333b-4350-8fbe-da1bdcb0a249 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:10.597786 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-41875233-333b-4350-8fbe-da1bdcb0a249 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:10.841076 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-12713449-c88e-45d9-a674-0b5e9e72002d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:10.849782 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-41875233-333b-4350-8fbe-da1bdcb0a249 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:10.860650 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-41875233-333b-4350-8fbe-da1bdcb0a249 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1322 microversion: 2.1 time: 0.302531 Jul 29 11:47:10.861240 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 46/100] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:10 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:47:10.864188 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-12713449-c88e-45d9-a674-0b5e9e72002d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1366 microversion: 2.1 time: 0.364312 Jul 29 11:47:10.877888 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 55/101] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:10 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:47:11.548344 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-bd38ced6-a1db-47dc-87cd-8ad45bb3c5d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:11.549121 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-bd38ced6-a1db-47dc-87cd-8ad45bb3c5d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:11.555373 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bd38ced6-a1db-47dc-87cd-8ad45bb3c5d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:11.555959 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bd38ced6-a1db-47dc-87cd-8ad45bb3c5d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:11.556723 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bd38ced6-a1db-47dc-87cd-8ad45bb3c5d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:11.557379 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bd38ced6-a1db-47dc-87cd-8ad45bb3c5d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:11.573173 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=100 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:11.704911 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-bd38ced6-a1db-47dc-87cd-8ad45bb3c5d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:11.713798 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-bd38ced6-a1db-47dc-87cd-8ad45bb3c5d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:11.715569 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-bd38ced6-a1db-47dc-87cd-8ad45bb3c5d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:11.716744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-bd38ced6-a1db-47dc-87cd-8ad45bb3c5d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1406 microversion: 2.20 time: 0.172638 Jul 29 11:47:11.717307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 47/102] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:47:11 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:47:11.882639 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9b7ea59a-2a5a-4a5f-9ba5-e9d527b5c592 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:11.883472 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-9b7ea59a-2a5a-4a5f-9ba5-e9d527b5c592 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:11.891882 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9b7ea59a-2a5a-4a5f-9ba5-e9d527b5c592 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:11.892311 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-3eedb4bc-ff2c-4861-86d1-a79e93edd876 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:11.892463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9b7ea59a-2a5a-4a5f-9ba5-e9d527b5c592 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:11.892952 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-3eedb4bc-ff2c-4861-86d1-a79e93edd876 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:11.893344 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9b7ea59a-2a5a-4a5f-9ba5-e9d527b5c592 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:11.893821 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9b7ea59a-2a5a-4a5f-9ba5-e9d527b5c592 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:11.899134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3eedb4bc-ff2c-4861-86d1-a79e93edd876 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:11.899594 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3eedb4bc-ff2c-4861-86d1-a79e93edd876 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:11.900372 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3eedb4bc-ff2c-4861-86d1-a79e93edd876 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:11.900795 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3eedb4bc-ff2c-4861-86d1-a79e93edd876 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:12.089616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-9b7ea59a-2a5a-4a5f-9ba5-e9d527b5c592 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:12.095990 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-3eedb4bc-ff2c-4861-86d1-a79e93edd876 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:12.100016 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-9b7ea59a-2a5a-4a5f-9ba5-e9d527b5c592 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1322 microversion: 2.1 time: 0.221702 Jul 29 11:47:12.101131 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 56/103] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:11 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:12.109042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-eb206095-4b25-49da-8985-c3f831c4c5c9 req-2053051d-eb2d-42da-be31-938e357ade52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8a2d21-648a-4b70-badd-2d7e499f5b90", "name": "network-vif-plugged", "status": "completed", "tag": "37549cbf-4d66-48e6-b4f4-c12905ec4351"}, {"server_uuid": "600bd88b-d9ed-4efe-a4fe-5ae8a93497c9", "name": "network-vif-plugged", "status": "completed", "tag": "c7dcc6c9-56c0-4221-a382-4dc2c7a538eb"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:47:12.117347 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-3eedb4bc-ff2c-4861-86d1-a79e93edd876 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1366 microversion: 2.1 time: 0.228627 Jul 29 11:47:12.118242 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 48/104] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:11 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:12.123938 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-eb206095-4b25-49da-8985-c3f831c4c5c9 req-2053051d-eb2d-42da-be31-938e357ade52 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:12.124380 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-eb206095-4b25-49da-8985-c3f831c4c5c9 req-2053051d-eb2d-42da-be31-938e357ade52 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:12.140685 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-eb206095-4b25-49da-8985-c3f831c4c5c9 req-2053051d-eb2d-42da-be31-938e357ade52 service nova] Creating event network-vif-plugged:37549cbf-4d66-48e6-b4f4-c12905ec4351 for instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 on hv-cinder-83754 Jul 29 11:47:12.141187 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-eb206095-4b25-49da-8985-c3f831c4c5c9 req-2053051d-eb2d-42da-be31-938e357ade52 service nova] Creating event network-vif-plugged:c7dcc6c9-56c0-4221-a382-4dc2c7a538eb for instance 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 on hv-cinder-83754 Jul 29 11:47:12.147860 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-eb206095-4b25-49da-8985-c3f831c4c5c9 req-2053051d-eb2d-42da-be31-938e357ade52 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045158 Jul 29 11:47:12.148445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 57/105] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:47:12.739058 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-98bf6fa7-5cf8-4366-b1f8-07501a1bb969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:12.739663 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-98bf6fa7-5cf8-4366-b1f8-07501a1bb969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:12.746314 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-98bf6fa7-5cf8-4366-b1f8-07501a1bb969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:12.746763 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-98bf6fa7-5cf8-4366-b1f8-07501a1bb969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:12.747518 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-98bf6fa7-5cf8-4366-b1f8-07501a1bb969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:12.747960 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-98bf6fa7-5cf8-4366-b1f8-07501a1bb969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:12.876943 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-98bf6fa7-5cf8-4366-b1f8-07501a1bb969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:12.884845 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-98bf6fa7-5cf8-4366-b1f8-07501a1bb969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:12.886594 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-98bf6fa7-5cf8-4366-b1f8-07501a1bb969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:12.887988 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-98bf6fa7-5cf8-4366-b1f8-07501a1bb969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1406 microversion: 2.20 time: 0.152852 Jul 29 11:47:12.888549 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 49/106] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:47:12 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:47:13.122643 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5e4fcdc4-b55b-4f62-809b-ce16afe66181 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:13.123341 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-5e4fcdc4-b55b-4f62-809b-ce16afe66181 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:13.130116 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5e4fcdc4-b55b-4f62-809b-ce16afe66181 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:13.130573 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5e4fcdc4-b55b-4f62-809b-ce16afe66181 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:13.131347 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5e4fcdc4-b55b-4f62-809b-ce16afe66181 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:13.131788 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5e4fcdc4-b55b-4f62-809b-ce16afe66181 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:13.136212 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:13.138075 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-7dafda5b-835a-48f3-b3d2-2f40ebf825bc tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:13.138705 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-7dafda5b-835a-48f3-b3d2-2f40ebf825bc tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:13.144768 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7dafda5b-835a-48f3-b3d2-2f40ebf825bc tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:13.145223 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7dafda5b-835a-48f3-b3d2-2f40ebf825bc tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:13.146029 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7dafda5b-835a-48f3-b3d2-2f40ebf825bc tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:13.146470 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7dafda5b-835a-48f3-b3d2-2f40ebf825bc tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:13.329348 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5e4fcdc4-b55b-4f62-809b-ce16afe66181 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:13.333593 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-7dafda5b-835a-48f3-b3d2-2f40ebf825bc tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:13.336830 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-5e4fcdc4-b55b-4f62-809b-ce16afe66181 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1322 microversion: 2.1 time: 0.219045 Jul 29 11:47:13.337404 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 58/107] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:13 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:47:13.341627 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-7dafda5b-835a-48f3-b3d2-2f40ebf825bc tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1366 microversion: 2.1 time: 0.207786 Jul 29 11:47:13.342201 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 50/108] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:13 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:47:13.910015 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-2416ed4e-7dba-4ba1-99a4-a09ec69dc37e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:13.910603 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-2416ed4e-7dba-4ba1-99a4-a09ec69dc37e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:13.916699 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2416ed4e-7dba-4ba1-99a4-a09ec69dc37e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:13.917145 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2416ed4e-7dba-4ba1-99a4-a09ec69dc37e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:13.917942 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2416ed4e-7dba-4ba1-99a4-a09ec69dc37e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:13.918374 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2416ed4e-7dba-4ba1-99a4-a09ec69dc37e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:14.047717 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2416ed4e-7dba-4ba1-99a4-a09ec69dc37e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:14.057687 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2416ed4e-7dba-4ba1-99a4-a09ec69dc37e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:14.061040 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2416ed4e-7dba-4ba1-99a4-a09ec69dc37e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:14.062638 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-2416ed4e-7dba-4ba1-99a4-a09ec69dc37e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1406 microversion: 2.20 time: 0.156533 Jul 29 11:47:14.063407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 59/109] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:47:13 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:47:14.360046 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4249f658-4a49-44c8-81bd-758e80c30646 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:14.360595 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4249f658-4a49-44c8-81bd-758e80c30646 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:14.363372 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d426b4a9-5c83-4a9d-87a8-4bda4142daaa tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:14.363996 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d426b4a9-5c83-4a9d-87a8-4bda4142daaa tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:14.367021 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4249f658-4a49-44c8-81bd-758e80c30646 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:14.367472 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4249f658-4a49-44c8-81bd-758e80c30646 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:14.368236 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4249f658-4a49-44c8-81bd-758e80c30646 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:14.368668 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4249f658-4a49-44c8-81bd-758e80c30646 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:14.371057 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d426b4a9-5c83-4a9d-87a8-4bda4142daaa tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:14.371510 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d426b4a9-5c83-4a9d-87a8-4bda4142daaa tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:14.372293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d426b4a9-5c83-4a9d-87a8-4bda4142daaa tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:14.372730 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d426b4a9-5c83-4a9d-87a8-4bda4142daaa tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:14.596416 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-4249f658-4a49-44c8-81bd-758e80c30646 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:14.600890 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d426b4a9-5c83-4a9d-87a8-4bda4142daaa tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:14.608739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4249f658-4a49-44c8-81bd-758e80c30646 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1322 microversion: 2.1 time: 0.253538 Jul 29 11:47:14.609345 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 51/110] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:14 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:14.611727 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d426b4a9-5c83-4a9d-87a8-4bda4142daaa tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1366 microversion: 2.1 time: 0.252344 Jul 29 11:47:14.612230 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 60/111] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:14 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:47:15.099176 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-19512ed6-0483-4f78-bc05-624844ef992c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:15.099840 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-19512ed6-0483-4f78-bc05-624844ef992c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:15.109291 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-19512ed6-0483-4f78-bc05-624844ef992c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:15.110112 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-19512ed6-0483-4f78-bc05-624844ef992c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:15.111073 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-19512ed6-0483-4f78-bc05-624844ef992c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:15.111745 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-19512ed6-0483-4f78-bc05-624844ef992c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:15.318349 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-19512ed6-0483-4f78-bc05-624844ef992c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:15.335327 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-19512ed6-0483-4f78-bc05-624844ef992c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:15.337197 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-19512ed6-0483-4f78-bc05-624844ef992c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:15.340101 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-19512ed6-0483-4f78-bc05-624844ef992c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1599 microversion: 2.20 time: 0.258259 Jul 29 11:47:15.340756 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 52/112] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:47:15 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1599 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:47:15.363750 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-03514cc2-1ece-471b-8442-ad818a93ff13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:15.364417 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-03514cc2-1ece-471b-8442-ad818a93ff13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:15.371465 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-03514cc2-1ece-471b-8442-ad818a93ff13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:15.371861 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-03514cc2-1ece-471b-8442-ad818a93ff13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:15.372625 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-03514cc2-1ece-471b-8442-ad818a93ff13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:15.373062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-03514cc2-1ece-471b-8442-ad818a93ff13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:15.455959 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-03514cc2-1ece-471b-8442-ad818a93ff13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096318 Jul 29 11:47:15.456581 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 61/113] 10.222.0.60 () {60 vars in 1316 bytes} [Fri Jul 29 11:47:15 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 11:47:15.634329 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-cdee3409-780d-4c73-be65-15f440a03af6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:15.634957 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-cdee3409-780d-4c73-be65-15f440a03af6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:15.638977 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-07db3e59-8dbd-47c6-b680-8dad3cdaacd1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:15.639601 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-07db3e59-8dbd-47c6-b680-8dad3cdaacd1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:15.655258 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cdee3409-780d-4c73-be65-15f440a03af6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:15.655258 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cdee3409-780d-4c73-be65-15f440a03af6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:15.655258 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cdee3409-780d-4c73-be65-15f440a03af6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:15.655258 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cdee3409-780d-4c73-be65-15f440a03af6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:15.656696 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-07db3e59-8dbd-47c6-b680-8dad3cdaacd1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:15.657163 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-07db3e59-8dbd-47c6-b680-8dad3cdaacd1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:15.658058 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-07db3e59-8dbd-47c6-b680-8dad3cdaacd1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:15.658505 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-07db3e59-8dbd-47c6-b680-8dad3cdaacd1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:16.109581 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-cdee3409-780d-4c73-be65-15f440a03af6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:16.116249 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-07db3e59-8dbd-47c6-b680-8dad3cdaacd1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:16.118150 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-cdee3409-780d-4c73-be65-15f440a03af6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1366 microversion: 2.1 time: 0.487687 Jul 29 11:47:16.119295 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 62/114] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:15 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1366 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:16.124666 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-07db3e59-8dbd-47c6-b680-8dad3cdaacd1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1322 microversion: 2.1 time: 0.498251 Jul 29 11:47:16.133569 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 53/115] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:15 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:17.138946 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4e91424d-0ce2-485a-aa1b-5c0be6643834 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:17.139556 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-4e91424d-0ce2-485a-aa1b-5c0be6643834 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:17.146445 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9ced63c5-07cb-4677-96d6-f69911b5b064 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:17.147747 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9ced63c5-07cb-4677-96d6-f69911b5b064 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:17.167600 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9ced63c5-07cb-4677-96d6-f69911b5b064 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:17.168179 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4e91424d-0ce2-485a-aa1b-5c0be6643834 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:17.168819 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4e91424d-0ce2-485a-aa1b-5c0be6643834 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:17.169827 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4e91424d-0ce2-485a-aa1b-5c0be6643834 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:17.170660 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9ced63c5-07cb-4677-96d6-f69911b5b064 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:17.171618 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9ced63c5-07cb-4677-96d6-f69911b5b064 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:17.172240 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4e91424d-0ce2-485a-aa1b-5c0be6643834 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:17.181140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9ced63c5-07cb-4677-96d6-f69911b5b064 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:17.518035 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9ced63c5-07cb-4677-96d6-f69911b5b064 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:17.529792 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4e91424d-0ce2-485a-aa1b-5c0be6643834 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:17.538026 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-4e91424d-0ce2-485a-aa1b-5c0be6643834 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1366 microversion: 2.1 time: 0.403460 Jul 29 11:47:17.539884 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 63/116] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:17 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:17.540312 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9ced63c5-07cb-4677-96d6-f69911b5b064 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1322 microversion: 2.1 time: 0.396994 Jul 29 11:47:17.554007 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 54/117] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:17 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:17.559781 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-763ab38b-b9b6-4073-93b6-bdf79f0c2766 req-9c12e1a0-3a81-4ba3-b78e-60b650ee43fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7bd0b02-2726-4432-a6a1-53035c9a1978", "tag": "fb1642b2-a468-43c6-8233-7e7bcc25cfcd"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:47:17.570474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-763ab38b-b9b6-4073-93b6-bdf79f0c2766 req-9c12e1a0-3a81-4ba3-b78e-60b650ee43fa service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:17.571064 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-763ab38b-b9b6-4073-93b6-bdf79f0c2766 req-9c12e1a0-3a81-4ba3-b78e-60b650ee43fa service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:17.584181 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-763ab38b-b9b6-4073-93b6-bdf79f0c2766 req-9c12e1a0-3a81-4ba3-b78e-60b650ee43fa service nova] Creating event network-changed:fb1642b2-a468-43c6-8233-7e7bcc25cfcd for instance d7bd0b02-2726-4432-a6a1-53035c9a1978 on hv-cinder-83754 Jul 29 11:47:17.591258 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-763ab38b-b9b6-4073-93b6-bdf79f0c2766 req-9c12e1a0-3a81-4ba3-b78e-60b650ee43fa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048462 Jul 29 11:47:17.592217 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 64/118] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:47:18.560099 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-3aea8cd4-afd6-4bc6-af79-4b5352c367a9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:18.561476 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-3aea8cd4-afd6-4bc6-af79-4b5352c367a9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:18.566207 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-17ce96b8-7c33-4438-bf39-1916e7ca9b3b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:18.567603 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-17ce96b8-7c33-4438-bf39-1916e7ca9b3b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:18.569156 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3aea8cd4-afd6-4bc6-af79-4b5352c367a9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:18.569803 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3aea8cd4-afd6-4bc6-af79-4b5352c367a9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:18.570924 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3aea8cd4-afd6-4bc6-af79-4b5352c367a9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:18.571719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3aea8cd4-afd6-4bc6-af79-4b5352c367a9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:18.575517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-17ce96b8-7c33-4438-bf39-1916e7ca9b3b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:18.575971 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-17ce96b8-7c33-4438-bf39-1916e7ca9b3b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:18.576890 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-17ce96b8-7c33-4438-bf39-1916e7ca9b3b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:18.577673 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-17ce96b8-7c33-4438-bf39-1916e7ca9b3b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:18.832130 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-17ce96b8-7c33-4438-bf39-1916e7ca9b3b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:18.834532 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-3aea8cd4-afd6-4bc6-af79-4b5352c367a9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:18.842748 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-3aea8cd4-afd6-4bc6-af79-4b5352c367a9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1366 microversion: 2.1 time: 0.286512 Jul 29 11:47:18.844117 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-17ce96b8-7c33-4438-bf39-1916e7ca9b3b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1322 microversion: 2.1 time: 0.283271 Jul 29 11:47:18.845476 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 65/119] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:18 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:47:18.854395 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 55/120] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:18 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:19.868294 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b1af3e9a-552a-47d6-990f-fea50c4d85f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:19.869850 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b1af3e9a-552a-47d6-990f-fea50c4d85f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:19.869993 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-651ce1c2-bc1d-466d-acec-87a4234f704a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:19.870650 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-651ce1c2-bc1d-466d-acec-87a4234f704a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:19.880644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b1af3e9a-552a-47d6-990f-fea50c4d85f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:19.881175 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b1af3e9a-552a-47d6-990f-fea50c4d85f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:19.883034 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b1af3e9a-552a-47d6-990f-fea50c4d85f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:19.883500 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-651ce1c2-bc1d-466d-acec-87a4234f704a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:19.883999 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b1af3e9a-552a-47d6-990f-fea50c4d85f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:19.884419 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-651ce1c2-bc1d-466d-acec-87a4234f704a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:19.885617 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-651ce1c2-bc1d-466d-acec-87a4234f704a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:19.886060 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-651ce1c2-bc1d-466d-acec-87a4234f704a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:20.277381 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-651ce1c2-bc1d-466d-acec-87a4234f704a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:20.290124 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-651ce1c2-bc1d-466d-acec-87a4234f704a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1556 microversion: 2.1 time: 0.421110 Jul 29 11:47:20.291211 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 56/121] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:19 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1556 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:47:20.312709 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-18275e06-8108-4e5c-8bad-e396be52be31 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:20.313674 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-18275e06-8108-4e5c-8bad-e396be52be31 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:20.320911 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-18275e06-8108-4e5c-8bad-e396be52be31 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:20.321609 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-18275e06-8108-4e5c-8bad-e396be52be31 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:20.323434 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-18275e06-8108-4e5c-8bad-e396be52be31 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:20.324171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-18275e06-8108-4e5c-8bad-e396be52be31 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:20.389578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b1af3e9a-552a-47d6-990f-fea50c4d85f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:20.399727 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b1af3e9a-552a-47d6-990f-fea50c4d85f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1515 microversion: 2.1 time: 0.533580 Jul 29 11:47:20.401061 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 66/122] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:19 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1515 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:20.422838 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-893b431e-242a-46f6-a5a8-6f9b9533f810 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:47:20.425821 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-893b431e-242a-46f6-a5a8-6f9b9533f810 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:20.434188 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-893b431e-242a-46f6-a5a8-6f9b9533f810 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:20.434858 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-893b431e-242a-46f6-a5a8-6f9b9533f810 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:20.435787 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-893b431e-242a-46f6-a5a8-6f9b9533f810 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:20.436368 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-893b431e-242a-46f6-a5a8-6f9b9533f810 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:20.467326 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-893b431e-242a-46f6-a5a8-6f9b9533f810 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lazy-loading 'flavor' on Instance uuid 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:47:20.522090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-18275e06-8108-4e5c-8bad-e396be52be31 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.213460 Jul 29 11:47:20.522886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 57/123] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Jul 29 11:47:20 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:47:20.618903 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-893b431e-242a-46f6-a5a8-6f9b9533f810 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "POST /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9/action" status: 200 len: 32 microversion: 2.1 time: 0.200172 Jul 29 11:47:20.620190 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 67/124] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Jul 29 11:47:20 2022] POST /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 29 11:47:20.631773 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ebe9eca0-2fb6-4e4d-bc00-0f391a47f780 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:20.633751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ebe9eca0-2fb6-4e4d-bc00-0f391a47f780 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:20.646576 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ebe9eca0-2fb6-4e4d-bc00-0f391a47f780 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:20.647524 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ebe9eca0-2fb6-4e4d-bc00-0f391a47f780 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:20.649090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ebe9eca0-2fb6-4e4d-bc00-0f391a47f780 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:20.650152 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ebe9eca0-2fb6-4e4d-bc00-0f391a47f780 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:21.024586 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ebe9eca0-2fb6-4e4d-bc00-0f391a47f780 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:21.034263 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ebe9eca0-2fb6-4e4d-bc00-0f391a47f780 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.408140 Jul 29 11:47:21.035194 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 58/125] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:20 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:22.058828 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-8c9f21a3-0539-4912-b0ee-e2ac3a24ef7f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:22.059605 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-8c9f21a3-0539-4912-b0ee-e2ac3a24ef7f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:22.083611 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8c9f21a3-0539-4912-b0ee-e2ac3a24ef7f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:22.084245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8c9f21a3-0539-4912-b0ee-e2ac3a24ef7f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:22.085036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8c9f21a3-0539-4912-b0ee-e2ac3a24ef7f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:22.085585 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8c9f21a3-0539-4912-b0ee-e2ac3a24ef7f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:22.548600 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-d14aa27e-2601-4ee0-a4d6-ae2228587b1c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:22.555333 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-d14aa27e-2601-4ee0-a4d6-ae2228587b1c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:22.567596 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d14aa27e-2601-4ee0-a4d6-ae2228587b1c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:22.568412 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d14aa27e-2601-4ee0-a4d6-ae2228587b1c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:22.569498 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d14aa27e-2601-4ee0-a4d6-ae2228587b1c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:22.570131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d14aa27e-2601-4ee0-a4d6-ae2228587b1c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:22.612134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-d14aa27e-2601-4ee0-a4d6-ae2228587b1c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Going to try to terminate instance {{(pid=129585) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:47:22.839912 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-d14aa27e-2601-4ee0-a4d6-ae2228587b1c tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 204 len: 0 microversion: 2.1 time: 0.293696 Jul 29 11:47:22.839912 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 59/126] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:47:22 2022] DELETE /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 11:47:22.849007 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-f519b183-3e5d-42f5-b795-4cad63518497 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:22.849801 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-f519b183-3e5d-42f5-b795-4cad63518497 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:22.859139 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f519b183-3e5d-42f5-b795-4cad63518497 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:22.859953 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f519b183-3e5d-42f5-b795-4cad63518497 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:22.861674 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f519b183-3e5d-42f5-b795-4cad63518497 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:22.862427 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f519b183-3e5d-42f5-b795-4cad63518497 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:22.920319 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-8c9f21a3-0539-4912-b0ee-e2ac3a24ef7f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:22.928380 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-8c9f21a3-0539-4912-b0ee-e2ac3a24ef7f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.875925 Jul 29 11:47:22.941847 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 68/127] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:22 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:23.220621 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-07067cfb-be6a-404b-a1ad-087a0e33ff40 req-b04fca76-fc2d-471f-bb86-d034d54ac6ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c8a2d21-648a-4b70-badd-2d7e499f5b90", "tag": "37549cbf-4d66-48e6-b4f4-c12905ec4351"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:47:23.239571 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-07067cfb-be6a-404b-a1ad-087a0e33ff40 req-b04fca76-fc2d-471f-bb86-d034d54ac6ca service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:23.245082 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-07067cfb-be6a-404b-a1ad-087a0e33ff40 req-b04fca76-fc2d-471f-bb86-d034d54ac6ca service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:23.261329 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-f519b183-3e5d-42f5-b795-4cad63518497 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:23.271019 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-07067cfb-be6a-404b-a1ad-087a0e33ff40 req-b04fca76-fc2d-471f-bb86-d034d54ac6ca service nova] Creating event network-changed:37549cbf-4d66-48e6-b4f4-c12905ec4351 for instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 on hv-cinder-83754 Jul 29 11:47:23.285989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-07067cfb-be6a-404b-a1ad-087a0e33ff40 req-b04fca76-fc2d-471f-bb86-d034d54ac6ca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068844 Jul 29 11:47:23.292854 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 69/128] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:47:23.304856 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-f519b183-3e5d-42f5-b795-4cad63518497 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1554 microversion: 2.1 time: 0.461265 Jul 29 11:47:23.308840 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 60/129] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:22 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1554 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:23.955883 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-2f8ad484-49c3-4ad2-a3a5-61713c53b60d tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:23.956592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-2f8ad484-49c3-4ad2-a3a5-61713c53b60d tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:23.967351 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2f8ad484-49c3-4ad2-a3a5-61713c53b60d tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:23.967816 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2f8ad484-49c3-4ad2-a3a5-61713c53b60d tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:23.968597 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2f8ad484-49c3-4ad2-a3a5-61713c53b60d tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:23.971659 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2f8ad484-49c3-4ad2-a3a5-61713c53b60d tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:24.149391 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2f8ad484-49c3-4ad2-a3a5-61713c53b60d tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:24.162354 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-2f8ad484-49c3-4ad2-a3a5-61713c53b60d tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.212095 Jul 29 11:47:24.183129 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 70/130] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:23 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:24.328515 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4ce31ac5-460e-47d7-82f1-7c8693f18dfc tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:24.330043 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4ce31ac5-460e-47d7-82f1-7c8693f18dfc tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:24.340220 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4ce31ac5-460e-47d7-82f1-7c8693f18dfc tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:24.344071 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4ce31ac5-460e-47d7-82f1-7c8693f18dfc tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:24.344998 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4ce31ac5-460e-47d7-82f1-7c8693f18dfc tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:24.345542 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4ce31ac5-460e-47d7-82f1-7c8693f18dfc tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:25.030840 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-4ce31ac5-460e-47d7-82f1-7c8693f18dfc tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:25.049730 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4ce31ac5-460e-47d7-82f1-7c8693f18dfc tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1554 microversion: 2.1 time: 0.725166 Jul 29 11:47:25.053454 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 61/131] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:24 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1554 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:25.185775 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3e49ba04-b208-41aa-a5af-009c9d234f13 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:25.186831 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3e49ba04-b208-41aa-a5af-009c9d234f13 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:25.205985 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3e49ba04-b208-41aa-a5af-009c9d234f13 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:25.207173 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3e49ba04-b208-41aa-a5af-009c9d234f13 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:25.207939 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3e49ba04-b208-41aa-a5af-009c9d234f13 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:25.208784 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3e49ba04-b208-41aa-a5af-009c9d234f13 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:25.625024 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3e49ba04-b208-41aa-a5af-009c9d234f13 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:25.633711 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3e49ba04-b208-41aa-a5af-009c9d234f13 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.453044 Jul 29 11:47:25.637655 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 71/132] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:25 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:26.076081 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-74d03082-9b4d-4b65-beb1-9647e906cb13 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:26.077256 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-74d03082-9b4d-4b65-beb1-9647e906cb13 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:26.088118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-74d03082-9b4d-4b65-beb1-9647e906cb13 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:26.089497 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-74d03082-9b4d-4b65-beb1-9647e906cb13 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:26.092908 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-74d03082-9b4d-4b65-beb1-9647e906cb13 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:26.093797 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-74d03082-9b4d-4b65-beb1-9647e906cb13 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:26.197936 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-74d03082-9b4d-4b65-beb1-9647e906cb13 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:26.200792 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:26.210636 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-74d03082-9b4d-4b65-beb1-9647e906cb13 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1512 microversion: 2.1 time: 0.139345 Jul 29 11:47:26.215217 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 62/133] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:26 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1512 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:26.358806 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-4275f73a-113e-4775-8146-e2086899aa57 req-eec89a8e-4e40-4307-8d10-2bfe822c099d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4", "name": "network-vif-deleted", "tag": "72de6824-05b0-479e-b6e6-0a65819542dc"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:47:26.373631 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-4275f73a-113e-4775-8146-e2086899aa57 req-eec89a8e-4e40-4307-8d10-2bfe822c099d service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:26.374334 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-4275f73a-113e-4775-8146-e2086899aa57 req-eec89a8e-4e40-4307-8d10-2bfe822c099d service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:26.407933 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-4275f73a-113e-4775-8146-e2086899aa57 req-eec89a8e-4e40-4307-8d10-2bfe822c099d service nova] Creating event network-vif-deleted:72de6824-05b0-479e-b6e6-0a65819542dc for instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 on hv-cinder-83754 Jul 29 11:47:26.417808 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-4275f73a-113e-4775-8146-e2086899aa57 req-eec89a8e-4e40-4307-8d10-2bfe822c099d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064236 Jul 29 11:47:26.422408 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 72/134] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:47:26.660689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5f117a4f-b6bf-4145-b1d9-da2994c3afc0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:26.661313 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-5f117a4f-b6bf-4145-b1d9-da2994c3afc0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:26.670054 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5f117a4f-b6bf-4145-b1d9-da2994c3afc0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:26.678192 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5f117a4f-b6bf-4145-b1d9-da2994c3afc0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:26.679280 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5f117a4f-b6bf-4145-b1d9-da2994c3afc0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:26.679883 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5f117a4f-b6bf-4145-b1d9-da2994c3afc0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:26.918796 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-5f117a4f-b6bf-4145-b1d9-da2994c3afc0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:26.927388 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-5f117a4f-b6bf-4145-b1d9-da2994c3afc0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.271149 Jul 29 11:47:26.929993 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 63/135] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:26 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:47:27.236927 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-a60c39af-2539-46ca-8c7f-0642800c54ac tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:27.237798 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-a60c39af-2539-46ca-8c7f-0642800c54ac tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:27.245760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a60c39af-2539-46ca-8c7f-0642800c54ac tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:27.246509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a60c39af-2539-46ca-8c7f-0642800c54ac tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:27.247727 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a60c39af-2539-46ca-8c7f-0642800c54ac tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:27.248432 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a60c39af-2539-46ca-8c7f-0642800c54ac tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:27.303476 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a60c39af-2539-46ca-8c7f-0642800c54ac tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:27.304075 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a60c39af-2539-46ca-8c7f-0642800c54ac tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:27.304938 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-a60c39af-2539-46ca-8c7f-0642800c54ac tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lazy-loading 'fault' on Instance uuid 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:47:27.370569 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a60c39af-2539-46ca-8c7f-0642800c54ac tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966689d952e14c1fb9007f2bdd7f03d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3261a30431d343a1bb170b67199c0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:27.383478 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-a60c39af-2539-46ca-8c7f-0642800c54ac tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 200 len: 1351 microversion: 2.1 time: 0.151369 Jul 29 11:47:27.385535 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 73/136] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:27 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 1351 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:27.951980 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-49d023ac-6e21-40b4-b660-41120bbd54f7 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:27.952593 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-49d023ac-6e21-40b4-b660-41120bbd54f7 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:27.961714 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-49d023ac-6e21-40b4-b660-41120bbd54f7 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:27.964699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-49d023ac-6e21-40b4-b660-41120bbd54f7 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:27.965801 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-49d023ac-6e21-40b4-b660-41120bbd54f7 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:27.968344 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-49d023ac-6e21-40b4-b660-41120bbd54f7 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:28.156119 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-49d023ac-6e21-40b4-b660-41120bbd54f7 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:28.164740 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-49d023ac-6e21-40b4-b660-41120bbd54f7 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.216930 Jul 29 11:47:28.166439 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 64/137] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:27 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:28.410597 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-021c77c1-f694-436a-97da-4e593777b559 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:28.411494 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-021c77c1-f694-436a-97da-4e593777b559 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:28.418850 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-021c77c1-f694-436a-97da-4e593777b559 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:28.419302 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-021c77c1-f694-436a-97da-4e593777b559 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:28.420072 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-021c77c1-f694-436a-97da-4e593777b559 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:28.420703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-021c77c1-f694-436a-97da-4e593777b559 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:28.434825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-021c77c1-f694-436a-97da-4e593777b559 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] HTTP exception thrown: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-021c77c1-f694-436a-97da-4e593777b559 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Request method failure captured: Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 HTTP/1.1 Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48iU007r22mLvqBuW7fvbeftG1nZWwilNoyzfbvImReLuUGoPX3wmuiRgPU7Sm8zDIBfu9PjaOaASswwa8Hdne1tSBh_ibvqvfkmZ0XdKK2TN4r8nystbBCKGGmAHsPPuRCXF-QHdMBWCkvNbMtdOn4wLWBqniqjvrPhIkk3__HY9q4 Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 3261a30431d343a1bb170b67199c0903 Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-DeleteServersTestJSON-1709791354 Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:47:28.439504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:47:28.440993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3261a30431d343a1bb170b67199c0903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3261a30431d343a1bb170b67199c0903", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3261a30431d343a1bb170b67199c0903"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3261a30431d343a1bb170b67199c0903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:47:28.440993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-DeleteServersTestJSON-1709791354 Jul 29 11:47:28.440993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 3261a30431d343a1bb170b67199c0903 Jul 29 11:47:28.440993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-DeleteServersTestJSON-1709791354 Jul 29 11:47:28.440993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-DeleteServersTestJSON-1709791354-project Jul 29 11:47:28.440993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:47:28.440993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:47:28.440993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 966689d952e14c1fb9007f2bdd7f03d3 Jul 29 11:47:28.440993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-DeleteServersTestJSON-1709791354-project Jul 29 11:47:28.440993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:47:28.440993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:28.440993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4'} Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:47:28.441877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:28.443309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:47:28.445173 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-021c77c1-f694-436a-97da-4e593777b559 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Returning 404 to user: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:47:28.446282 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-021c77c1-f694-436a-97da-4e593777b559 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 404 len: 111 microversion: 2.1 time: 0.039638 Jul 29 11:47:28.447336 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 74/138] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:28 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:47:28.573937 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6f5b8379-97cb-45d1-8d0e-6f53bedb15ee tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:28.577350 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6f5b8379-97cb-45d1-8d0e-6f53bedb15ee tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:28.584906 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6f5b8379-97cb-45d1-8d0e-6f53bedb15ee tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:28.585377 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6f5b8379-97cb-45d1-8d0e-6f53bedb15ee tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:28.586151 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6f5b8379-97cb-45d1-8d0e-6f53bedb15ee tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:28.586583 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6f5b8379-97cb-45d1-8d0e-6f53bedb15ee tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:28.601390 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-6f5b8379-97cb-45d1-8d0e-6f53bedb15ee tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] HTTP exception thrown: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6f5b8379-97cb-45d1-8d0e-6f53bedb15ee tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Request method failure captured: Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4/os-volume_attachments HTTP/1.1 Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48iU007r22mLvqBuW7fvbeftG1nZWwilNoyzfbvImReLuUGoPX3wmuiRgPU7Sm8zDIBfu9PjaOaASswwa8Hdne1tSBh_ibvqvfkmZ0XdKK2TN4r8nystbBCKGGmAHsPPuRCXF-QHdMBWCkvNbMtdOn4wLWBqniqjvrPhIkk3__HY9q4 Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 3261a30431d343a1bb170b67199c0903 Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-DeleteServersTestJSON-1709791354 Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:47:28.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:47:28.608684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3261a30431d343a1bb170b67199c0903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3261a30431d343a1bb170b67199c0903", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3261a30431d343a1bb170b67199c0903"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3261a30431d343a1bb170b67199c0903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:47:28.608684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-DeleteServersTestJSON-1709791354 Jul 29 11:47:28.608684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 3261a30431d343a1bb170b67199c0903 Jul 29 11:47:28.608684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-DeleteServersTestJSON-1709791354 Jul 29 11:47:28.608684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-DeleteServersTestJSON-1709791354-project Jul 29 11:47:28.608684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:47:28.608684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:47:28.608684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 966689d952e14c1fb9007f2bdd7f03d3 Jul 29 11:47:28.608684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-DeleteServersTestJSON-1709791354-project Jul 29 11:47:28.608684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:47:28.608684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:28.608684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'server_id': '1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4'} Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:47:28.609326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:28.610475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:47:28.611653 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6f5b8379-97cb-45d1-8d0e-6f53bedb15ee tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Returning 404 to user: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:47:28.611653 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6f5b8379-97cb-45d1-8d0e-6f53bedb15ee tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039616 Jul 29 11:47:28.611653 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 65/139] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:47:28 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:47:29.186950 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-cc62ee22-5119-4791-a397-a792741e1f62 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:29.187561 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-cc62ee22-5119-4791-a397-a792741e1f62 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:29.193141 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=80 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:29.194695 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cc62ee22-5119-4791-a397-a792741e1f62 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:29.195618 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cc62ee22-5119-4791-a397-a792741e1f62 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:29.197387 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cc62ee22-5119-4791-a397-a792741e1f62 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:29.198165 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cc62ee22-5119-4791-a397-a792741e1f62 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:29.219810 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:29.369709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-cc62ee22-5119-4791-a397-a792741e1f62 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:29.377937 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-cc62ee22-5119-4791-a397-a792741e1f62 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.195098 Jul 29 11:47:29.378777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 75/140] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:29 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:29.831109 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6318677b-115f-4223-ae86-503300c7bfd1 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:29.831646 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6318677b-115f-4223-ae86-503300c7bfd1 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:29.834169 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:29.853833 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6318677b-115f-4223-ae86-503300c7bfd1 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:29.853833 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6318677b-115f-4223-ae86-503300c7bfd1 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:29.853833 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6318677b-115f-4223-ae86-503300c7bfd1 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:29.853833 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6318677b-115f-4223-ae86-503300c7bfd1 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:29.859020 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-6318677b-115f-4223-ae86-503300c7bfd1 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] HTTP exception thrown: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6318677b-115f-4223-ae86-503300c7bfd1 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Request method failure captured: Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: DELETE /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 HTTP/1.1 Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48iU007r22mLvqBuW7fvbeftG1nZWwilNoyzfbvImReLuUGoPX3wmuiRgPU7Sm8zDIBfu9PjaOaASswwa8Hdne1tSBh_ibvqvfkmZ0XdKK2TN4r8nystbBCKGGmAHsPPuRCXF-QHdMBWCkvNbMtdOn4wLWBqniqjvrPhIkk3__HY9q4 Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 3261a30431d343a1bb170b67199c0903 Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-DeleteServersTestJSON-1709791354 Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:47:29.861865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:47:29.863016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3261a30431d343a1bb170b67199c0903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3261a30431d343a1bb170b67199c0903", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3261a30431d343a1bb170b67199c0903"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3261a30431d343a1bb170b67199c0903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:47:29.863016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-DeleteServersTestJSON-1709791354 Jul 29 11:47:29.863016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 3261a30431d343a1bb170b67199c0903 Jul 29 11:47:29.863016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-DeleteServersTestJSON-1709791354 Jul 29 11:47:29.863016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-DeleteServersTestJSON-1709791354-project Jul 29 11:47:29.863016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:47:29.863016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:47:29.863016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 966689d952e14c1fb9007f2bdd7f03d3 Jul 29 11:47:29.863016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-DeleteServersTestJSON-1709791354-project Jul 29 11:47:29.863016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:47:29.863016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:29.863016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': '1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4'} Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:47:29.863681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:29.865317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:47:29.866758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6318677b-115f-4223-ae86-503300c7bfd1 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Returning 404 to user: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:47:29.866758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6318677b-115f-4223-ae86-503300c7bfd1 tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 404 len: 111 microversion: 2.1 time: 0.036621 Jul 29 11:47:29.866758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 66/141] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:47:29 2022] DELETE /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:47:29.872688 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5b3c0347-d548-4337-958f-91911917ec9a tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:29.873299 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-5b3c0347-d548-4337-958f-91911917ec9a tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] [instance: 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:29.880898 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5b3c0347-d548-4337-958f-91911917ec9a tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:29.881260 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5b3c0347-d548-4337-958f-91911917ec9a tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:29.882140 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5b3c0347-d548-4337-958f-91911917ec9a tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:29.882745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5b3c0347-d548-4337-958f-91911917ec9a tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:29.907645 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-5b3c0347-d548-4337-958f-91911917ec9a tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] HTTP exception thrown: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5b3c0347-d548-4337-958f-91911917ec9a tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Request method failure captured: Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 HTTP/1.1 Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48iU007r22mLvqBuW7fvbeftG1nZWwilNoyzfbvImReLuUGoPX3wmuiRgPU7Sm8zDIBfu9PjaOaASswwa8Hdne1tSBh_ibvqvfkmZ0XdKK2TN4r8nystbBCKGGmAHsPPuRCXF-QHdMBWCkvNbMtdOn4wLWBqniqjvrPhIkk3__HY9q4 Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 3261a30431d343a1bb170b67199c0903 Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-DeleteServersTestJSON-1709791354 Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:47:29.909245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:47:29.910564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3261a30431d343a1bb170b67199c0903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3261a30431d343a1bb170b67199c0903", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3261a30431d343a1bb170b67199c0903"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3261a30431d343a1bb170b67199c0903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:47:29.910564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-DeleteServersTestJSON-1709791354 Jul 29 11:47:29.910564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 3261a30431d343a1bb170b67199c0903 Jul 29 11:47:29.910564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-DeleteServersTestJSON-1709791354 Jul 29 11:47:29.910564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-DeleteServersTestJSON-1709791354-project Jul 29 11:47:29.910564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:47:29.910564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:47:29.910564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 966689d952e14c1fb9007f2bdd7f03d3 Jul 29 11:47:29.910564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-DeleteServersTestJSON-1709791354-project Jul 29 11:47:29.910564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:47:29.910564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:29.910564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4'} Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:47:29.911200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. Jul 29 11:47:29.912218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:47:29.913169 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5b3c0347-d548-4337-958f-91911917ec9a tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] Returning 404 to user: Instance 1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:47:29.913169 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-5b3c0347-d548-4337-958f-91911917ec9a tempest-DeleteServersTestJSON-1709791354 tempest-DeleteServersTestJSON-1709791354-project] 10.222.0.60 "GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4" status: 404 len: 111 microversion: 2.1 time: 0.042828 Jul 29 11:47:29.913169 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 76/142] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:29 2022] GET /compute/v2.1/servers/1f5c8ddc-5cbd-4ac9-bbe5-f8be744660d4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:47:30.399502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-808786d4-a860-4794-844f-8394ee6e3412 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:30.400850 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-808786d4-a860-4794-844f-8394ee6e3412 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:30.407687 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-808786d4-a860-4794-844f-8394ee6e3412 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:30.408144 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-808786d4-a860-4794-844f-8394ee6e3412 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:30.408913 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-808786d4-a860-4794-844f-8394ee6e3412 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:30.409350 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-808786d4-a860-4794-844f-8394ee6e3412 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:30.541676 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-808786d4-a860-4794-844f-8394ee6e3412 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:30.549380 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-808786d4-a860-4794-844f-8394ee6e3412 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.153731 Jul 29 11:47:30.550116 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 67/143] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:30 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:31.571527 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ac65d6f5-98c9-40bd-8cbd-ccfb72692f33 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:31.572723 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ac65d6f5-98c9-40bd-8cbd-ccfb72692f33 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:31.579674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ac65d6f5-98c9-40bd-8cbd-ccfb72692f33 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:31.580267 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ac65d6f5-98c9-40bd-8cbd-ccfb72692f33 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:31.581169 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ac65d6f5-98c9-40bd-8cbd-ccfb72692f33 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:31.581510 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ac65d6f5-98c9-40bd-8cbd-ccfb72692f33 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:31.722917 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ac65d6f5-98c9-40bd-8cbd-ccfb72692f33 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:31.730547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ac65d6f5-98c9-40bd-8cbd-ccfb72692f33 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.163079 Jul 29 11:47:31.731225 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 77/144] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:31 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:32.753088 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-fd0b7992-47e6-439d-8ef1-87dc2d2788e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:32.753744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-fd0b7992-47e6-439d-8ef1-87dc2d2788e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:32.766239 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fd0b7992-47e6-439d-8ef1-87dc2d2788e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:32.766696 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fd0b7992-47e6-439d-8ef1-87dc2d2788e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:32.767573 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fd0b7992-47e6-439d-8ef1-87dc2d2788e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:32.768029 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fd0b7992-47e6-439d-8ef1-87dc2d2788e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:33.048514 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fd0b7992-47e6-439d-8ef1-87dc2d2788e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:33.059524 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-fd0b7992-47e6-439d-8ef1-87dc2d2788e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.310409 Jul 29 11:47:33.069965 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 68/145] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:32 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:34.084854 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-88020e85-4bec-4561-a5d5-694083e76b77 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:34.085476 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-88020e85-4bec-4561-a5d5-694083e76b77 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:34.094433 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-88020e85-4bec-4561-a5d5-694083e76b77 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:34.095176 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-88020e85-4bec-4561-a5d5-694083e76b77 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:34.095993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-88020e85-4bec-4561-a5d5-694083e76b77 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:34.096584 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-88020e85-4bec-4561-a5d5-694083e76b77 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:34.315611 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-88020e85-4bec-4561-a5d5-694083e76b77 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:34.324645 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-88020e85-4bec-4561-a5d5-694083e76b77 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.244781 Jul 29 11:47:34.325319 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 78/146] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:34 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:35.345630 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-79ea6ec7-1305-4212-861d-8f80e6f23bf8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:35.346909 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-79ea6ec7-1305-4212-861d-8f80e6f23bf8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:35.354629 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-79ea6ec7-1305-4212-861d-8f80e6f23bf8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:35.355343 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-79ea6ec7-1305-4212-861d-8f80e6f23bf8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:35.356294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-79ea6ec7-1305-4212-861d-8f80e6f23bf8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:35.356899 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-79ea6ec7-1305-4212-861d-8f80e6f23bf8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:35.545537 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-79ea6ec7-1305-4212-861d-8f80e6f23bf8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:35.555555 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-79ea6ec7-1305-4212-861d-8f80e6f23bf8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.213862 Jul 29 11:47:35.556106 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 69/147] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:35 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:36.578234 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-fffbc8fb-b6e6-4b71-a1da-e246b21dcdb4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:36.579434 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-fffbc8fb-b6e6-4b71-a1da-e246b21dcdb4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:36.591551 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fffbc8fb-b6e6-4b71-a1da-e246b21dcdb4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:36.593049 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fffbc8fb-b6e6-4b71-a1da-e246b21dcdb4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:36.598543 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fffbc8fb-b6e6-4b71-a1da-e246b21dcdb4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:36.599600 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fffbc8fb-b6e6-4b71-a1da-e246b21dcdb4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:36.798283 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-fffbc8fb-b6e6-4b71-a1da-e246b21dcdb4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:36.815814 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-fffbc8fb-b6e6-4b71-a1da-e246b21dcdb4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.242366 Jul 29 11:47:36.816091 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 79/148] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:36 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:37.836795 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-145f0d48-e0a0-4d3e-a60e-ab28e5c8f968 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:37.838166 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-145f0d48-e0a0-4d3e-a60e-ab28e5c8f968 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:37.844619 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-145f0d48-e0a0-4d3e-a60e-ab28e5c8f968 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:37.845350 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-145f0d48-e0a0-4d3e-a60e-ab28e5c8f968 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:37.846503 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-145f0d48-e0a0-4d3e-a60e-ab28e5c8f968 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:37.847696 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-145f0d48-e0a0-4d3e-a60e-ab28e5c8f968 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:38.322529 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-145f0d48-e0a0-4d3e-a60e-ab28e5c8f968 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:38.334419 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-145f0d48-e0a0-4d3e-a60e-ab28e5c8f968 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.500970 Jul 29 11:47:38.340542 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 70/149] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:37 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:39.361601 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-a7ffe26b-f3bb-498c-aece-0a91922e3f1c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:39.362373 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-a7ffe26b-f3bb-498c-aece-0a91922e3f1c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:39.381022 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a7ffe26b-f3bb-498c-aece-0a91922e3f1c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:39.381022 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a7ffe26b-f3bb-498c-aece-0a91922e3f1c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:39.381022 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a7ffe26b-f3bb-498c-aece-0a91922e3f1c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:39.381022 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a7ffe26b-f3bb-498c-aece-0a91922e3f1c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:39.544590 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a7ffe26b-f3bb-498c-aece-0a91922e3f1c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:39.552626 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-a7ffe26b-f3bb-498c-aece-0a91922e3f1c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.194928 Jul 29 11:47:39.553370 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 80/150] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:39 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:40.574127 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6fd8f9da-09b2-43de-8b48-c0dfd3f7dc86 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:40.574693 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6fd8f9da-09b2-43de-8b48-c0dfd3f7dc86 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:40.584185 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6fd8f9da-09b2-43de-8b48-c0dfd3f7dc86 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:40.584516 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6fd8f9da-09b2-43de-8b48-c0dfd3f7dc86 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:40.585502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6fd8f9da-09b2-43de-8b48-c0dfd3f7dc86 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:40.586085 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6fd8f9da-09b2-43de-8b48-c0dfd3f7dc86 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:40.783123 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6fd8f9da-09b2-43de-8b48-c0dfd3f7dc86 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:40.792592 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6fd8f9da-09b2-43de-8b48-c0dfd3f7dc86 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.222689 Jul 29 11:47:40.799120 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 71/151] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:40 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:41.816066 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-51b1a07a-3fc5-4347-8417-eb4ecbd5de73 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:41.817690 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-51b1a07a-3fc5-4347-8417-eb4ecbd5de73 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:41.825390 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-51b1a07a-3fc5-4347-8417-eb4ecbd5de73 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:41.826018 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-51b1a07a-3fc5-4347-8417-eb4ecbd5de73 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:41.826920 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-51b1a07a-3fc5-4347-8417-eb4ecbd5de73 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:41.827443 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-51b1a07a-3fc5-4347-8417-eb4ecbd5de73 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:42.008079 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-51b1a07a-3fc5-4347-8417-eb4ecbd5de73 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:42.019766 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-51b1a07a-3fc5-4347-8417-eb4ecbd5de73 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.207550 Jul 29 11:47:42.020357 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 81/152] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:41 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:43.047260 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4be668d2-347f-49e1-a94c-f73aeb77d818 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:43.047869 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4be668d2-347f-49e1-a94c-f73aeb77d818 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:43.053863 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4be668d2-347f-49e1-a94c-f73aeb77d818 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:43.054458 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4be668d2-347f-49e1-a94c-f73aeb77d818 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:43.055402 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4be668d2-347f-49e1-a94c-f73aeb77d818 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:43.056603 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4be668d2-347f-49e1-a94c-f73aeb77d818 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:43.203334 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-4be668d2-347f-49e1-a94c-f73aeb77d818 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:43.211201 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4be668d2-347f-49e1-a94c-f73aeb77d818 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.167851 Jul 29 11:47:43.211811 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 72/153] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:43 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:44.239300 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-64138173-dbc2-49f3-a52a-80ad0e6824a8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:44.240011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-64138173-dbc2-49f3-a52a-80ad0e6824a8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:44.256983 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-64138173-dbc2-49f3-a52a-80ad0e6824a8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:44.257488 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-64138173-dbc2-49f3-a52a-80ad0e6824a8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:44.259267 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-64138173-dbc2-49f3-a52a-80ad0e6824a8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:44.262334 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-64138173-dbc2-49f3-a52a-80ad0e6824a8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:44.425841 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-64138173-dbc2-49f3-a52a-80ad0e6824a8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:44.435066 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-64138173-dbc2-49f3-a52a-80ad0e6824a8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.206251 Jul 29 11:47:44.449263 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 82/154] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:44 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:45.458019 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-fecfecac-d15e-41a8-b876-a4082151a907 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:45.458804 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-fecfecac-d15e-41a8-b876-a4082151a907 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:45.466575 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fecfecac-d15e-41a8-b876-a4082151a907 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:45.467126 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fecfecac-d15e-41a8-b876-a4082151a907 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:45.468053 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fecfecac-d15e-41a8-b876-a4082151a907 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:45.468642 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fecfecac-d15e-41a8-b876-a4082151a907 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:45.629750 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fecfecac-d15e-41a8-b876-a4082151a907 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:45.640068 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-fecfecac-d15e-41a8-b876-a4082151a907 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.186852 Jul 29 11:47:45.640640 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 73/155] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:45 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:46.660856 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f8c634b4-7b39-427a-bd56-71bbaaf5d49b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:46.661585 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f8c634b4-7b39-427a-bd56-71bbaaf5d49b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:46.668975 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f8c634b4-7b39-427a-bd56-71bbaaf5d49b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:46.669542 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f8c634b4-7b39-427a-bd56-71bbaaf5d49b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:46.670390 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f8c634b4-7b39-427a-bd56-71bbaaf5d49b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:46.670908 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f8c634b4-7b39-427a-bd56-71bbaaf5d49b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:46.847416 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f8c634b4-7b39-427a-bd56-71bbaaf5d49b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:46.857253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f8c634b4-7b39-427a-bd56-71bbaaf5d49b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.200133 Jul 29 11:47:46.857874 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 83/156] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:46 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:47.880430 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5b5e1b86-198b-40eb-b3fa-caf5c266dd96 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:47.881700 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-5b5e1b86-198b-40eb-b3fa-caf5c266dd96 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:47.889373 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5b5e1b86-198b-40eb-b3fa-caf5c266dd96 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:47.890077 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5b5e1b86-198b-40eb-b3fa-caf5c266dd96 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:47.890928 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5b5e1b86-198b-40eb-b3fa-caf5c266dd96 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:47.891346 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5b5e1b86-198b-40eb-b3fa-caf5c266dd96 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:48.037110 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-5b5e1b86-198b-40eb-b3fa-caf5c266dd96 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:48.046915 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-5b5e1b86-198b-40eb-b3fa-caf5c266dd96 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.170267 Jul 29 11:47:48.048544 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 74/157] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:47 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:49.068963 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-2df8cefe-a551-4407-8672-14ab6d82ff72 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:49.069600 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-2df8cefe-a551-4407-8672-14ab6d82ff72 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:49.076894 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2df8cefe-a551-4407-8672-14ab6d82ff72 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:49.077352 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2df8cefe-a551-4407-8672-14ab6d82ff72 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:49.078146 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2df8cefe-a551-4407-8672-14ab6d82ff72 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:49.078778 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2df8cefe-a551-4407-8672-14ab6d82ff72 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:49.235184 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2df8cefe-a551-4407-8672-14ab6d82ff72 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:49.245194 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-2df8cefe-a551-4407-8672-14ab6d82ff72 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.179898 Jul 29 11:47:49.246106 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 84/158] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:49 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:50.267931 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-aadacd43-9f5a-4027-9525-a36a44a030d0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:50.268557 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-aadacd43-9f5a-4027-9525-a36a44a030d0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:50.277376 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-aadacd43-9f5a-4027-9525-a36a44a030d0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:50.277807 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-aadacd43-9f5a-4027-9525-a36a44a030d0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:50.279397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-aadacd43-9f5a-4027-9525-a36a44a030d0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:50.279990 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-aadacd43-9f5a-4027-9525-a36a44a030d0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:50.520415 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-aadacd43-9f5a-4027-9525-a36a44a030d0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:50.543363 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-aadacd43-9f5a-4027-9525-a36a44a030d0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.279939 Jul 29 11:47:50.544347 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 75/159] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:50 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:51.567699 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c7fedc6b-40b9-43aa-a9f2-f2eb272e62d5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:51.568333 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c7fedc6b-40b9-43aa-a9f2-f2eb272e62d5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:51.581740 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c7fedc6b-40b9-43aa-a9f2-f2eb272e62d5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:51.582199 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c7fedc6b-40b9-43aa-a9f2-f2eb272e62d5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:51.582986 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c7fedc6b-40b9-43aa-a9f2-f2eb272e62d5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:51.583420 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c7fedc6b-40b9-43aa-a9f2-f2eb272e62d5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:51.809756 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c7fedc6b-40b9-43aa-a9f2-f2eb272e62d5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:51.817548 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c7fedc6b-40b9-43aa-a9f2-f2eb272e62d5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.253506 Jul 29 11:47:51.821800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 85/160] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:51 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:52.854123 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5ebcf87b-cac5-4151-9e56-978fc350b4f0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:52.854654 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-5ebcf87b-cac5-4151-9e56-978fc350b4f0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:52.861208 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5ebcf87b-cac5-4151-9e56-978fc350b4f0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:52.861697 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5ebcf87b-cac5-4151-9e56-978fc350b4f0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:52.862471 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5ebcf87b-cac5-4151-9e56-978fc350b4f0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:52.862909 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5ebcf87b-cac5-4151-9e56-978fc350b4f0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:53.018976 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-5ebcf87b-cac5-4151-9e56-978fc350b4f0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:53.026808 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-5ebcf87b-cac5-4151-9e56-978fc350b4f0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.177457 Jul 29 11:47:53.027377 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 76/161] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:52 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:54.048568 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e8f08a92-79a2-41f1-b8cb-d3b12336ae56 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:54.049187 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e8f08a92-79a2-41f1-b8cb-d3b12336ae56 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:54.056584 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e8f08a92-79a2-41f1-b8cb-d3b12336ae56 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:54.057055 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e8f08a92-79a2-41f1-b8cb-d3b12336ae56 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:54.057872 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e8f08a92-79a2-41f1-b8cb-d3b12336ae56 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:54.058480 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e8f08a92-79a2-41f1-b8cb-d3b12336ae56 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:54.228505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e8f08a92-79a2-41f1-b8cb-d3b12336ae56 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:54.236546 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e8f08a92-79a2-41f1-b8cb-d3b12336ae56 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.192815 Jul 29 11:47:54.237287 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 86/162] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:54 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:55.257896 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-880ca418-c5ca-4bdd-8e1b-9844dadb5a03 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:55.259229 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-880ca418-c5ca-4bdd-8e1b-9844dadb5a03 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:55.265509 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-880ca418-c5ca-4bdd-8e1b-9844dadb5a03 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:55.265958 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-880ca418-c5ca-4bdd-8e1b-9844dadb5a03 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:55.266715 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-880ca418-c5ca-4bdd-8e1b-9844dadb5a03 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:55.267174 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-880ca418-c5ca-4bdd-8e1b-9844dadb5a03 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:55.396576 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-880ca418-c5ca-4bdd-8e1b-9844dadb5a03 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:55.404910 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-880ca418-c5ca-4bdd-8e1b-9844dadb5a03 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.150826 Jul 29 11:47:55.405510 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 77/163] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:55 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:55.429051 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-46e0bb70-1cee-447d-bc4c-94c56cf0c8fb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2106407187", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452", "networks": [{"uuid": "4993d81f-11a0-4255-ad5a-9700754167c4"}]}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:47:55.481768 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.network.neutron [None req-46e0bb70-1cee-447d-bc4c-94c56cf0c8fb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] validate_networks() for [('4993d81f-11a0-4255-ad5a-9700754167c4', None, None, None, None, None)] {{(pid=129584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:47:55.849789 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-46e0bb70-1cee-447d-bc4c-94c56cf0c8fb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Flavor limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:47:55.850217 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-46e0bb70-1cee-447d-bc4c-94c56cf0c8fb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Image limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:47:55.850779 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-46e0bb70-1cee-447d-bc4c-94c56cf0c8fb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Flavor pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:47:55.851200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-46e0bb70-1cee-447d-bc4c-94c56cf0c8fb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Image pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:47:55.851611 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-46e0bb70-1cee-447d-bc4c-94c56cf0c8fb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:47:55.868330 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-46e0bb70-1cee-447d-bc4c-94c56cf0c8fb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:55.868983 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-46e0bb70-1cee-447d-bc4c-94c56cf0c8fb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:55.870498 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-46e0bb70-1cee-447d-bc4c-94c56cf0c8fb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:55.870949 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-46e0bb70-1cee-447d-bc4c-94c56cf0c8fb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:55.890362 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-46e0bb70-1cee-447d-bc4c-94c56cf0c8fb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Getting quotas for project 1658d63aa1b54aa5a36754e83179e317. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:47:55.894606 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-46e0bb70-1cee-447d-bc4c-94c56cf0c8fb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Getting quotas for user 0c22bac56ed1472a9b2e7b6943736333 and project 1658d63aa1b54aa5a36754e83179e317. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:47:55.918561 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-46e0bb70-1cee-447d-bc4c-94c56cf0c8fb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Going to run 1 instances... {{(pid=129584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:47:55.922546 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-46e0bb70-1cee-447d-bc4c-94c56cf0c8fb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:47:55.973806 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-46e0bb70-1cee-447d-bc4c-94c56cf0c8fb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548473 Jul 29 11:47:55.974608 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 87/164] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:47:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 11:47:55.985673 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-68624dad-d93c-4312-a188-4b144ef7ea53 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:55.986300 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-68624dad-d93c-4312-a188-4b144ef7ea53 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:56.046172 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-68624dad-d93c-4312-a188-4b144ef7ea53 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:56.054399 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-68624dad-d93c-4312-a188-4b144ef7ea53 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1219 microversion: 2.1 time: 0.072579 Jul 29 11:47:56.055743 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 78/165] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:55 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:56.430992 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-10324fa1-a200-46a8-9a62-60e15adba470 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:56.431606 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-10324fa1-a200-46a8-9a62-60e15adba470 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:56.437800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-10324fa1-a200-46a8-9a62-60e15adba470 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:56.438245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-10324fa1-a200-46a8-9a62-60e15adba470 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:56.439007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-10324fa1-a200-46a8-9a62-60e15adba470 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:56.439434 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-10324fa1-a200-46a8-9a62-60e15adba470 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:56.576813 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-10324fa1-a200-46a8-9a62-60e15adba470 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:56.584497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-10324fa1-a200-46a8-9a62-60e15adba470 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.161375 Jul 29 11:47:56.585074 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 88/166] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:56 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:57.076054 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-92df3ebb-0685-4bc9-819e-970506f1aa8a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:57.076666 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-92df3ebb-0685-4bc9-819e-970506f1aa8a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:57.082939 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-92df3ebb-0685-4bc9-819e-970506f1aa8a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:57.083393 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-92df3ebb-0685-4bc9-819e-970506f1aa8a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:57.084152 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-92df3ebb-0685-4bc9-819e-970506f1aa8a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:57.084588 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-92df3ebb-0685-4bc9-819e-970506f1aa8a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:57.088617 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=84 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:57.148424 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-92df3ebb-0685-4bc9-819e-970506f1aa8a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:57.155979 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-92df3ebb-0685-4bc9-819e-970506f1aa8a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1223 microversion: 2.1 time: 0.083685 Jul 29 11:47:57.156555 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 79/167] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:57 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:47:57.606243 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-7a8c862a-687e-4476-8ed9-79ef161bfdaa tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:57.606860 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-7a8c862a-687e-4476-8ed9-79ef161bfdaa tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:57.613485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7a8c862a-687e-4476-8ed9-79ef161bfdaa tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:57.613905 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7a8c862a-687e-4476-8ed9-79ef161bfdaa tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:57.614679 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7a8c862a-687e-4476-8ed9-79ef161bfdaa tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:57.615118 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7a8c862a-687e-4476-8ed9-79ef161bfdaa tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:57.743740 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-7a8c862a-687e-4476-8ed9-79ef161bfdaa tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:57.751168 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-7a8c862a-687e-4476-8ed9-79ef161bfdaa tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.149850 Jul 29 11:47:57.751724 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 89/168] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:57 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:58.177285 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-05e86236-0cc1-40d1-b129-2bf484fd99e9 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:58.178454 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-05e86236-0cc1-40d1-b129-2bf484fd99e9 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:58.185223 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-05e86236-0cc1-40d1-b129-2bf484fd99e9 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:58.185772 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-05e86236-0cc1-40d1-b129-2bf484fd99e9 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:58.186549 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-05e86236-0cc1-40d1-b129-2bf484fd99e9 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:58.186983 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-05e86236-0cc1-40d1-b129-2bf484fd99e9 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:58.251699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-05e86236-0cc1-40d1-b129-2bf484fd99e9 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:58.259342 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-05e86236-0cc1-40d1-b129-2bf484fd99e9 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1215 microversion: 2.1 time: 0.085919 Jul 29 11:47:58.259903 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 80/169] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:58 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:58.772524 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-bb49992f-9da7-4ddc-b4ac-3c147147b6f2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:58.773167 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-bb49992f-9da7-4ddc-b4ac-3c147147b6f2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:58.780343 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bb49992f-9da7-4ddc-b4ac-3c147147b6f2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:58.780799 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bb49992f-9da7-4ddc-b4ac-3c147147b6f2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:58.781600 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bb49992f-9da7-4ddc-b4ac-3c147147b6f2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:58.782043 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bb49992f-9da7-4ddc-b4ac-3c147147b6f2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:58.949937 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bb49992f-9da7-4ddc-b4ac-3c147147b6f2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:58.958012 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-bb49992f-9da7-4ddc-b4ac-3c147147b6f2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.189445 Jul 29 11:47:58.958603 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 90/170] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:58 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:59.285669 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8dbb9b60-82f3-48bb-9b5f-fc18162c6d24 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:59.286800 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8dbb9b60-82f3-48bb-9b5f-fc18162c6d24 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:59.297336 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8dbb9b60-82f3-48bb-9b5f-fc18162c6d24 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:59.298278 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8dbb9b60-82f3-48bb-9b5f-fc18162c6d24 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:59.299754 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8dbb9b60-82f3-48bb-9b5f-fc18162c6d24 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:47:59.300629 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8dbb9b60-82f3-48bb-9b5f-fc18162c6d24 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:47:59.391285 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-8dbb9b60-82f3-48bb-9b5f-fc18162c6d24 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:47:59.400653 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8dbb9b60-82f3-48bb-9b5f-fc18162c6d24 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1279 microversion: 2.1 time: 0.122465 Jul 29 11:47:59.401268 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 81/171] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:59 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1279 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:47:59.604089 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f6974fef-c7b5-4c3c-a2a0-432f18e15894 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1184066425", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452"}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:47:59.612507 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:47:59.682760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.network.neutron [None req-f6974fef-c7b5-4c3c-a2a0-432f18e15894 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] validate_networks() for None {{(pid=129584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:47:59.988441 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-2c57010c-4028-4312-85e5-d24e4e1f1403 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:47:59.989098 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-2c57010c-4028-4312-85e5-d24e4e1f1403 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:47:59.991102 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=34 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:00.004006 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2c57010c-4028-4312-85e5-d24e4e1f1403 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:00.006600 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2c57010c-4028-4312-85e5-d24e4e1f1403 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:00.007432 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2c57010c-4028-4312-85e5-d24e4e1f1403 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:00.009296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-f6974fef-c7b5-4c3c-a2a0-432f18e15894 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Flavor limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:48:00.009946 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2c57010c-4028-4312-85e5-d24e4e1f1403 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:00.010283 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-f6974fef-c7b5-4c3c-a2a0-432f18e15894 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Image limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:48:00.012538 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-f6974fef-c7b5-4c3c-a2a0-432f18e15894 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Flavor pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:48:00.013214 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-f6974fef-c7b5-4c3c-a2a0-432f18e15894 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Image pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:48:00.013764 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-f6974fef-c7b5-4c3c-a2a0-432f18e15894 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:48:00.024266 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f6974fef-c7b5-4c3c-a2a0-432f18e15894 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:00.025148 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f6974fef-c7b5-4c3c-a2a0-432f18e15894 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:00.026175 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f6974fef-c7b5-4c3c-a2a0-432f18e15894 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:00.027262 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f6974fef-c7b5-4c3c-a2a0-432f18e15894 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:00.037528 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=85 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:00.059766 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-f6974fef-c7b5-4c3c-a2a0-432f18e15894 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Getting quotas for project 460961ebb939469c96621850ab00bd8e. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:48:00.066671 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-f6974fef-c7b5-4c3c-a2a0-432f18e15894 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Getting quotas for user eb1af73fd4ac487fac1568cb445a511d and project 460961ebb939469c96621850ab00bd8e. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:48:00.082328 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f6974fef-c7b5-4c3c-a2a0-432f18e15894 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Going to run 1 instances... {{(pid=129584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:48:00.085164 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f6974fef-c7b5-4c3c-a2a0-432f18e15894 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:48:00.195694 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f6974fef-c7b5-4c3c-a2a0-432f18e15894 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598942 Jul 29 11:48:00.197242 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 91/172] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:47:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 11:48:00.232250 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b1fcceb1-3794-4eb6-b311-790977b1031b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:00.234691 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b1fcceb1-3794-4eb6-b311-790977b1031b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:00.361239 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-2c57010c-4028-4312-85e5-d24e4e1f1403 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:00.376894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-2c57010c-4028-4312-85e5-d24e4e1f1403 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.392274 Jul 29 11:48:00.380823 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 82/173] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:47:59 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:48:00.431008 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b1fcceb1-3794-4eb6-b311-790977b1031b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:00.437333 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c2632ee9-f671-407b-b56a-5ff3faf6bd52 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:00.438275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-c2632ee9-f671-407b-b56a-5ff3faf6bd52 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:00.452032 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c2632ee9-f671-407b-b56a-5ff3faf6bd52 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:00.452479 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c2632ee9-f671-407b-b56a-5ff3faf6bd52 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:00.453308 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b1fcceb1-3794-4eb6-b311-790977b1031b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1215 microversion: 2.1 time: 0.248644 Jul 29 11:48:00.453941 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 92/174] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:00 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1215 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:48:00.454751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c2632ee9-f671-407b-b56a-5ff3faf6bd52 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:00.455255 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c2632ee9-f671-407b-b56a-5ff3faf6bd52 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:00.537146 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-c2632ee9-f671-407b-b56a-5ff3faf6bd52 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:00.547290 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-c2632ee9-f671-407b-b56a-5ff3faf6bd52 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1277 microversion: 2.1 time: 0.120642 Jul 29 11:48:00.553897 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 83/175] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:00 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1277 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:01.411198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c24e93f7-2222-413e-af67-a0d2d1e399c3 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:01.412440 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c24e93f7-2222-413e-af67-a0d2d1e399c3 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:01.422422 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c24e93f7-2222-413e-af67-a0d2d1e399c3 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:01.422763 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c24e93f7-2222-413e-af67-a0d2d1e399c3 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:01.423552 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c24e93f7-2222-413e-af67-a0d2d1e399c3 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:01.423992 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c24e93f7-2222-413e-af67-a0d2d1e399c3 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:01.479438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-96d2a886-3bc8-430d-85f4-d5481241b78d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:01.481025 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-96d2a886-3bc8-430d-85f4-d5481241b78d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:01.496587 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-96d2a886-3bc8-430d-85f4-d5481241b78d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:01.497042 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-96d2a886-3bc8-430d-85f4-d5481241b78d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:01.498039 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-96d2a886-3bc8-430d-85f4-d5481241b78d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:01.498720 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-96d2a886-3bc8-430d-85f4-d5481241b78d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:01.605171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-96d2a886-3bc8-430d-85f4-d5481241b78d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:01.619629 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-96d2a886-3bc8-430d-85f4-d5481241b78d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1267 microversion: 2.1 time: 0.145661 Jul 29 11:48:01.630654 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 84/176] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:01 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:01.642803 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-504ffc3f-c1bc-471d-83fe-3197c0646970 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:01.643663 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-504ffc3f-c1bc-471d-83fe-3197c0646970 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:01.647383 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c24e93f7-2222-413e-af67-a0d2d1e399c3 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:01.656338 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c24e93f7-2222-413e-af67-a0d2d1e399c3 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.249148 Jul 29 11:48:01.658351 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 93/177] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:01 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:01.666312 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-504ffc3f-c1bc-471d-83fe-3197c0646970 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:01.667030 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-504ffc3f-c1bc-471d-83fe-3197c0646970 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:01.668435 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-504ffc3f-c1bc-471d-83fe-3197c0646970 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:01.668885 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-504ffc3f-c1bc-471d-83fe-3197c0646970 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:01.686691 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-6f5c1b51-d163-458c-9cc2-5f2f8eed096b req-6186e334-51a3-45b3-9d28-290e0bb5572d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7529e35b-c6b2-4c8f-896c-fd2060f91657", "tag": "f123c03d-aaa7-4c59-a7db-11c40621e5c6"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:01.706228 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-6f5c1b51-d163-458c-9cc2-5f2f8eed096b req-6186e334-51a3-45b3-9d28-290e0bb5572d service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:01.706870 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-6f5c1b51-d163-458c-9cc2-5f2f8eed096b req-6186e334-51a3-45b3-9d28-290e0bb5572d service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:01.733520 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-6f5c1b51-d163-458c-9cc2-5f2f8eed096b req-6186e334-51a3-45b3-9d28-290e0bb5572d service nova] Creating event network-changed:f123c03d-aaa7-4c59-a7db-11c40621e5c6 for instance 7529e35b-c6b2-4c8f-896c-fd2060f91657 on hv-cinder-83754 Jul 29 11:48:01.739009 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-6f5c1b51-d163-458c-9cc2-5f2f8eed096b req-6186e334-51a3-45b3-9d28-290e0bb5572d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057196 Jul 29 11:48:01.739610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 94/178] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:48:01.831666 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-504ffc3f-c1bc-471d-83fe-3197c0646970 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:01.840362 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-504ffc3f-c1bc-471d-83fe-3197c0646970 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.207722 Jul 29 11:48:01.840937 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 85/179] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:01 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:02.657222 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4d35b231-4233-4152-9de9-815e2b980457 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:02.657954 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-4d35b231-4233-4152-9de9-815e2b980457 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:02.664809 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4d35b231-4233-4152-9de9-815e2b980457 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:02.665190 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4d35b231-4233-4152-9de9-815e2b980457 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:02.666089 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4d35b231-4233-4152-9de9-815e2b980457 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:02.666528 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4d35b231-4233-4152-9de9-815e2b980457 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:02.681280 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-0f3af268-be09-4950-b7a1-6dc4c720314e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:02.681840 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-0f3af268-be09-4950-b7a1-6dc4c720314e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:02.687970 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0f3af268-be09-4950-b7a1-6dc4c720314e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:02.688420 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0f3af268-be09-4950-b7a1-6dc4c720314e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:02.689195 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0f3af268-be09-4950-b7a1-6dc4c720314e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:02.689692 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0f3af268-be09-4950-b7a1-6dc4c720314e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:02.735888 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4d35b231-4233-4152-9de9-815e2b980457 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:02.744303 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-4d35b231-4233-4152-9de9-815e2b980457 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1267 microversion: 2.1 time: 0.091735 Jul 29 11:48:02.744876 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 95/180] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:02 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:02.838574 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-0f3af268-be09-4950-b7a1-6dc4c720314e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:02.847323 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-0f3af268-be09-4950-b7a1-6dc4c720314e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1521 microversion: 2.1 time: 0.170698 Jul 29 11:48:02.847901 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 86/181] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:02 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:48:02.861042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d1cea783-617f-4a77-8615-00487708675f tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:02.861802 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d1cea783-617f-4a77-8615-00487708675f tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:02.869178 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d1cea783-617f-4a77-8615-00487708675f tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:02.869749 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d1cea783-617f-4a77-8615-00487708675f tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:02.870618 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d1cea783-617f-4a77-8615-00487708675f tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:02.871057 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d1cea783-617f-4a77-8615-00487708675f tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:03.007908 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d1cea783-617f-4a77-8615-00487708675f tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:03.015949 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d1cea783-617f-4a77-8615-00487708675f tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.159215 Jul 29 11:48:03.016522 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 96/182] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:02 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:03.765760 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-0bcb8e32-48e0-4b09-bf58-71f0eae435b4 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:03.766307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-0bcb8e32-48e0-4b09-bf58-71f0eae435b4 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:03.772475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0bcb8e32-48e0-4b09-bf58-71f0eae435b4 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:03.772930 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0bcb8e32-48e0-4b09-bf58-71f0eae435b4 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:03.773951 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0bcb8e32-48e0-4b09-bf58-71f0eae435b4 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:03.774432 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0bcb8e32-48e0-4b09-bf58-71f0eae435b4 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:03.850381 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-0bcb8e32-48e0-4b09-bf58-71f0eae435b4 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:03.858510 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-0bcb8e32-48e0-4b09-bf58-71f0eae435b4 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1267 microversion: 2.1 time: 0.097151 Jul 29 11:48:03.859121 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 87/183] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:03 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:03.871020 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f0320dda-d3b6-4cf3-bafa-dc0d287fe588 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:03.871475 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f0320dda-d3b6-4cf3-bafa-dc0d287fe588 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:03.878332 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f0320dda-d3b6-4cf3-bafa-dc0d287fe588 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:03.878727 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f0320dda-d3b6-4cf3-bafa-dc0d287fe588 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:03.879496 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f0320dda-d3b6-4cf3-bafa-dc0d287fe588 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:03.879960 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f0320dda-d3b6-4cf3-bafa-dc0d287fe588 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:04.019775 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f0320dda-d3b6-4cf3-bafa-dc0d287fe588 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:04.027906 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f0320dda-d3b6-4cf3-bafa-dc0d287fe588 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1501 microversion: 2.1 time: 0.161939 Jul 29 11:48:04.028473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 97/184] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:03 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:48:04.037761 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-df0276d9-1363-46f2-bfd6-4c354745094a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:04.038377 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-df0276d9-1363-46f2-bfd6-4c354745094a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:04.045026 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-df0276d9-1363-46f2-bfd6-4c354745094a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:04.045521 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-df0276d9-1363-46f2-bfd6-4c354745094a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:04.046299 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-df0276d9-1363-46f2-bfd6-4c354745094a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:04.046742 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-df0276d9-1363-46f2-bfd6-4c354745094a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:04.047710 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-cff22c47-0fd1-4806-a27c-ed18a841619f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:04.048316 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-cff22c47-0fd1-4806-a27c-ed18a841619f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:04.054382 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cff22c47-0fd1-4806-a27c-ed18a841619f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:04.055006 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cff22c47-0fd1-4806-a27c-ed18a841619f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:04.055878 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cff22c47-0fd1-4806-a27c-ed18a841619f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:04.056336 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cff22c47-0fd1-4806-a27c-ed18a841619f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:04.477713 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-df0276d9-1363-46f2-bfd6-4c354745094a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:04.481274 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-cff22c47-0fd1-4806-a27c-ed18a841619f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:04.487650 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-df0276d9-1363-46f2-bfd6-4c354745094a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.453608 Jul 29 11:48:04.488331 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 88/185] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:04 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:04.489004 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-cff22c47-0fd1-4806-a27c-ed18a841619f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1516 microversion: 2.1 time: 0.444963 Jul 29 11:48:04.489699 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 98/186] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:04 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1516 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:48:04.883162 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9d832c22-39b9-4ea7-b022-5571608c560d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:04.884400 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9d832c22-39b9-4ea7-b022-5571608c560d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:04.891537 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d832c22-39b9-4ea7-b022-5571608c560d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:04.892074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d832c22-39b9-4ea7-b022-5571608c560d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:04.893057 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d832c22-39b9-4ea7-b022-5571608c560d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:04.893547 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d832c22-39b9-4ea7-b022-5571608c560d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:04.962904 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9d832c22-39b9-4ea7-b022-5571608c560d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:04.971039 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9d832c22-39b9-4ea7-b022-5571608c560d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1273 microversion: 2.1 time: 0.091763 Jul 29 11:48:04.971881 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 89/187] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:04 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:48:05.511102 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5ecb3bdd-e433-4717-92ae-ae8b70352345 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:05.512024 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-5ecb3bdd-e433-4717-92ae-ae8b70352345 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:05.519198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5ecb3bdd-e433-4717-92ae-ae8b70352345 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:05.520026 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5ecb3bdd-e433-4717-92ae-ae8b70352345 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:05.520831 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5ecb3bdd-e433-4717-92ae-ae8b70352345 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:05.521274 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5ecb3bdd-e433-4717-92ae-ae8b70352345 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:05.656395 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5ecb3bdd-e433-4717-92ae-ae8b70352345 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:05.665248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-5ecb3bdd-e433-4717-92ae-ae8b70352345 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.159919 Jul 29 11:48:05.665860 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 99/188] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:05 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:05.935417 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-57df4da1-2051-4423-91ae-3414d3db5139 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:05.937907 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-57df4da1-2051-4423-91ae-3414d3db5139 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:05.944113 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-57df4da1-2051-4423-91ae-3414d3db5139 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:05.944559 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-57df4da1-2051-4423-91ae-3414d3db5139 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:05.946135 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-57df4da1-2051-4423-91ae-3414d3db5139 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:05.946578 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-57df4da1-2051-4423-91ae-3414d3db5139 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:05.969820 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.objects.instance [None req-57df4da1-2051-4423-91ae-3414d3db5139 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lazy-loading 'flavor' on Instance uuid 8e39f512-b616-4e06-9f81-f853454d67aa {{(pid=129585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:48:05.995791 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-76b0142e-1b01-46d9-bf08-54dcce813573 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:05.997191 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-76b0142e-1b01-46d9-bf08-54dcce813573 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:06.008173 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-76b0142e-1b01-46d9-bf08-54dcce813573 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:06.008946 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-76b0142e-1b01-46d9-bf08-54dcce813573 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:06.010261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-76b0142e-1b01-46d9-bf08-54dcce813573 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:06.011038 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-76b0142e-1b01-46d9-bf08-54dcce813573 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:06.050672 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:06.077115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-76b0142e-1b01-46d9-bf08-54dcce813573 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:06.084963 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-76b0142e-1b01-46d9-bf08-54dcce813573 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1273 microversion: 2.1 time: 0.097046 Jul 29 11:48:06.087626 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 100/189] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:05 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:48:06.130411 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-57df4da1-2051-4423-91ae-3414d3db5139 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "POST /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa/action" status: 200 len: 32 microversion: 2.1 time: 0.199242 Jul 29 11:48:06.131763 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 90/190] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Jul 29 11:48:05 2022] POST /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa/action => generated 32 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 29 11:48:06.141532 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5c8d1da9-e94f-4e59-ae79-9da52dbfe897 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:06.142256 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-5c8d1da9-e94f-4e59-ae79-9da52dbfe897 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:06.149111 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5c8d1da9-e94f-4e59-ae79-9da52dbfe897 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:06.149721 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5c8d1da9-e94f-4e59-ae79-9da52dbfe897 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:06.150717 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5c8d1da9-e94f-4e59-ae79-9da52dbfe897 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:06.151247 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5c8d1da9-e94f-4e59-ae79-9da52dbfe897 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:06.306144 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5c8d1da9-e94f-4e59-ae79-9da52dbfe897 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:06.314833 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-5c8d1da9-e94f-4e59-ae79-9da52dbfe897 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.177261 Jul 29 11:48:06.315945 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 101/191] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:06 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:06.689209 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-3fc6d5b3-2f28-4941-9d8e-32d67bd3eb4d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:06.689935 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-3fc6d5b3-2f28-4941-9d8e-32d67bd3eb4d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:06.696786 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3fc6d5b3-2f28-4941-9d8e-32d67bd3eb4d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:06.697240 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3fc6d5b3-2f28-4941-9d8e-32d67bd3eb4d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:06.698118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3fc6d5b3-2f28-4941-9d8e-32d67bd3eb4d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:06.698554 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3fc6d5b3-2f28-4941-9d8e-32d67bd3eb4d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:06.835875 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-3fc6d5b3-2f28-4941-9d8e-32d67bd3eb4d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:06.843686 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-3fc6d5b3-2f28-4941-9d8e-32d67bd3eb4d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.158659 Jul 29 11:48:06.844258 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 91/192] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:06 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:07.107327 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3f7578dc-0e8a-4e86-ba0c-7ea0be27e7fb tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:07.107858 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3f7578dc-0e8a-4e86-ba0c-7ea0be27e7fb tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:07.114417 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3f7578dc-0e8a-4e86-ba0c-7ea0be27e7fb tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:07.114871 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3f7578dc-0e8a-4e86-ba0c-7ea0be27e7fb tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:07.115658 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3f7578dc-0e8a-4e86-ba0c-7ea0be27e7fb tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:07.116090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3f7578dc-0e8a-4e86-ba0c-7ea0be27e7fb tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:07.243815 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3f7578dc-0e8a-4e86-ba0c-7ea0be27e7fb tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:07.251179 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3f7578dc-0e8a-4e86-ba0c-7ea0be27e7fb tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1315 microversion: 2.1 time: 0.147771 Jul 29 11:48:07.251743 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 102/193] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:07 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:07.337060 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5e59011e-6354-49f7-80c0-e176059e2093 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:07.337696 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-5e59011e-6354-49f7-80c0-e176059e2093 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:07.343636 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5e59011e-6354-49f7-80c0-e176059e2093 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:07.344075 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5e59011e-6354-49f7-80c0-e176059e2093 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:07.344829 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5e59011e-6354-49f7-80c0-e176059e2093 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:07.345565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5e59011e-6354-49f7-80c0-e176059e2093 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:07.476033 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-5e59011e-6354-49f7-80c0-e176059e2093 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:07.483406 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-5e59011e-6354-49f7-80c0-e176059e2093 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.150955 Jul 29 11:48:07.483967 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 92/194] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:07 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:07.864188 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-bcfdc24f-b556-4101-a523-45872e4eab1f tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:07.864721 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-bcfdc24f-b556-4101-a523-45872e4eab1f tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:07.870978 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bcfdc24f-b556-4101-a523-45872e4eab1f tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:07.871427 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bcfdc24f-b556-4101-a523-45872e4eab1f tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:07.872183 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bcfdc24f-b556-4101-a523-45872e4eab1f tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:07.872612 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bcfdc24f-b556-4101-a523-45872e4eab1f tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:08.002244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bcfdc24f-b556-4101-a523-45872e4eab1f tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:08.010357 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-bcfdc24f-b556-4101-a523-45872e4eab1f tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.150096 Jul 29 11:48:08.010928 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 103/195] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:07 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:08.272591 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-2962d3b4-6de0-46c9-9422-95ed18d5937f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:08.273364 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-2962d3b4-6de0-46c9-9422-95ed18d5937f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:08.279779 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2962d3b4-6de0-46c9-9422-95ed18d5937f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:08.280226 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2962d3b4-6de0-46c9-9422-95ed18d5937f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:08.281012 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2962d3b4-6de0-46c9-9422-95ed18d5937f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:08.281467 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2962d3b4-6de0-46c9-9422-95ed18d5937f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:08.413901 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-2962d3b4-6de0-46c9-9422-95ed18d5937f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:08.416200 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:08.423079 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-2962d3b4-6de0-46c9-9422-95ed18d5937f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1315 microversion: 2.1 time: 0.154279 Jul 29 11:48:08.423647 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 93/196] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:08 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:08.504337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-34640df6-aa5b-4f48-8e9a-92cccb53a878 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:08.504855 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-34640df6-aa5b-4f48-8e9a-92cccb53a878 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:08.512042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-34640df6-aa5b-4f48-8e9a-92cccb53a878 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:08.512492 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-34640df6-aa5b-4f48-8e9a-92cccb53a878 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:08.513272 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-34640df6-aa5b-4f48-8e9a-92cccb53a878 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:08.513731 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-34640df6-aa5b-4f48-8e9a-92cccb53a878 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:08.641133 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-34640df6-aa5b-4f48-8e9a-92cccb53a878 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:08.649211 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-34640df6-aa5b-4f48-8e9a-92cccb53a878 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.148762 Jul 29 11:48:08.649808 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 104/197] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:08 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:09.031289 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-25b616d2-3363-4275-963a-5fa5b8789302 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:09.032015 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-25b616d2-3363-4275-963a-5fa5b8789302 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:09.038867 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-25b616d2-3363-4275-963a-5fa5b8789302 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:09.040168 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-25b616d2-3363-4275-963a-5fa5b8789302 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:09.041010 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-25b616d2-3363-4275-963a-5fa5b8789302 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:09.041550 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-25b616d2-3363-4275-963a-5fa5b8789302 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:09.201258 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-25b616d2-3363-4275-963a-5fa5b8789302 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:09.209533 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-25b616d2-3363-4275-963a-5fa5b8789302 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.182030 Jul 29 11:48:09.210116 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 94/198] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:09 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:09.363881 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-af8b9c0f-597e-4be0-a2c4-1ceb886f3446 req-d3da0dc8-a9bb-4302-8f52-59f6bc3256bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b642f8-7f80-47f7-a283-ee2a69bdc693", "tag": "519417b3-986b-45dd-940a-074d514f506f"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:09.375361 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-af8b9c0f-597e-4be0-a2c4-1ceb886f3446 req-d3da0dc8-a9bb-4302-8f52-59f6bc3256bd service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:09.376581 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-af8b9c0f-597e-4be0-a2c4-1ceb886f3446 req-d3da0dc8-a9bb-4302-8f52-59f6bc3256bd service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:09.390486 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-af8b9c0f-597e-4be0-a2c4-1ceb886f3446 req-d3da0dc8-a9bb-4302-8f52-59f6bc3256bd service nova] Creating event network-changed:519417b3-986b-45dd-940a-074d514f506f for instance d2b642f8-7f80-47f7-a283-ee2a69bdc693 on hv-cinder-83754 Jul 29 11:48:09.395740 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-af8b9c0f-597e-4be0-a2c4-1ceb886f3446 req-d3da0dc8-a9bb-4302-8f52-59f6bc3256bd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035699 Jul 29 11:48:09.396371 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 105/199] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:48:09.443481 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a4b203e5-b969-45d1-827a-242a4622400e tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:09.444100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a4b203e5-b969-45d1-827a-242a4622400e tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:09.450592 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a4b203e5-b969-45d1-827a-242a4622400e tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:09.451318 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a4b203e5-b969-45d1-827a-242a4622400e tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:09.452297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a4b203e5-b969-45d1-827a-242a4622400e tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:09.452737 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a4b203e5-b969-45d1-827a-242a4622400e tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:09.583067 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a4b203e5-b969-45d1-827a-242a4622400e tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:09.591361 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a4b203e5-b969-45d1-827a-242a4622400e tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1315 microversion: 2.1 time: 0.151720 Jul 29 11:48:09.592798 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 95/200] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:09 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:09.671412 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-7ec3f103-5114-4924-b59d-19e406d43557 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:09.672437 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-7ec3f103-5114-4924-b59d-19e406d43557 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:09.678700 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7ec3f103-5114-4924-b59d-19e406d43557 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:09.679245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7ec3f103-5114-4924-b59d-19e406d43557 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:09.680647 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7ec3f103-5114-4924-b59d-19e406d43557 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:09.681154 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7ec3f103-5114-4924-b59d-19e406d43557 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:09.867552 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-7ec3f103-5114-4924-b59d-19e406d43557 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:09.879006 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-7ec3f103-5114-4924-b59d-19e406d43557 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.212350 Jul 29 11:48:09.880586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 106/201] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:09 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:10.233522 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9d90a57e-c8b2-4e0e-9b53-19087cdf563d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:10.235026 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9d90a57e-c8b2-4e0e-9b53-19087cdf563d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:10.242889 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d90a57e-c8b2-4e0e-9b53-19087cdf563d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:10.243367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d90a57e-c8b2-4e0e-9b53-19087cdf563d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:10.244365 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d90a57e-c8b2-4e0e-9b53-19087cdf563d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:10.244803 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d90a57e-c8b2-4e0e-9b53-19087cdf563d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:10.409128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9d90a57e-c8b2-4e0e-9b53-19087cdf563d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:10.416861 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9d90a57e-c8b2-4e0e-9b53-19087cdf563d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.190587 Jul 29 11:48:10.417439 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 96/202] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:10 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:10.613208 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-bc325dfa-1eb2-46fb-98a4-d5abc1c1785c tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:10.613839 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-bc325dfa-1eb2-46fb-98a4-d5abc1c1785c tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:10.615936 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=4 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:10.616611 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=14 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:10.623649 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bc325dfa-1eb2-46fb-98a4-d5abc1c1785c tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:10.624227 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bc325dfa-1eb2-46fb-98a4-d5abc1c1785c tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:10.625027 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bc325dfa-1eb2-46fb-98a4-d5abc1c1785c tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:10.625481 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bc325dfa-1eb2-46fb-98a4-d5abc1c1785c tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:10.752714 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bc325dfa-1eb2-46fb-98a4-d5abc1c1785c tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:10.760255 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-bc325dfa-1eb2-46fb-98a4-d5abc1c1785c tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1315 microversion: 2.1 time: 0.150891 Jul 29 11:48:10.760812 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 107/203] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:10 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:10.903055 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-585dc78f-750a-43ff-a92b-93b9a40544b1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:10.903671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-585dc78f-750a-43ff-a92b-93b9a40544b1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:10.909828 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-585dc78f-750a-43ff-a92b-93b9a40544b1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:10.910282 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-585dc78f-750a-43ff-a92b-93b9a40544b1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:10.911046 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-585dc78f-750a-43ff-a92b-93b9a40544b1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:10.911478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-585dc78f-750a-43ff-a92b-93b9a40544b1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:11.043743 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-585dc78f-750a-43ff-a92b-93b9a40544b1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:11.051330 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-585dc78f-750a-43ff-a92b-93b9a40544b1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.152437 Jul 29 11:48:11.051898 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 97/204] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:10 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:11.437949 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9ceccf95-211e-4230-869d-b371b18f9ba3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:11.438566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-9ceccf95-211e-4230-869d-b371b18f9ba3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:11.444557 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9ceccf95-211e-4230-869d-b371b18f9ba3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:11.445010 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9ceccf95-211e-4230-869d-b371b18f9ba3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:11.445841 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9ceccf95-211e-4230-869d-b371b18f9ba3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:11.446323 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9ceccf95-211e-4230-869d-b371b18f9ba3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:11.577327 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-9ceccf95-211e-4230-869d-b371b18f9ba3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:11.584719 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-9ceccf95-211e-4230-869d-b371b18f9ba3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.150590 Jul 29 11:48:11.585286 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 108/205] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:11 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:11.781181 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-87d62624-6d75-4122-8b0b-e74ded29539a tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:11.781746 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-87d62624-6d75-4122-8b0b-e74ded29539a tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:11.787794 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-87d62624-6d75-4122-8b0b-e74ded29539a tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:11.788245 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-87d62624-6d75-4122-8b0b-e74ded29539a tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:11.789003 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-87d62624-6d75-4122-8b0b-e74ded29539a tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:11.789453 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-87d62624-6d75-4122-8b0b-e74ded29539a tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:11.917107 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-87d62624-6d75-4122-8b0b-e74ded29539a tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:11.924655 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-87d62624-6d75-4122-8b0b-e74ded29539a tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1315 microversion: 2.1 time: 0.147388 Jul 29 11:48:11.925217 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 98/206] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:11 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:12.072481 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d949ec0c-ad67-4265-b00c-fd362c96498a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:12.073041 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d949ec0c-ad67-4265-b00c-fd362c96498a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:12.080508 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d949ec0c-ad67-4265-b00c-fd362c96498a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:12.080953 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d949ec0c-ad67-4265-b00c-fd362c96498a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:12.081749 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d949ec0c-ad67-4265-b00c-fd362c96498a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:12.082207 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d949ec0c-ad67-4265-b00c-fd362c96498a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:12.217464 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d949ec0c-ad67-4265-b00c-fd362c96498a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:12.225454 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d949ec0c-ad67-4265-b00c-fd362c96498a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.157355 Jul 29 11:48:12.226248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 109/207] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:12 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:12.606246 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-b22944bb-8f20-4f98-a193-da66c8897f49 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:12.606788 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-b22944bb-8f20-4f98-a193-da66c8897f49 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:12.612786 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b22944bb-8f20-4f98-a193-da66c8897f49 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:12.613240 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b22944bb-8f20-4f98-a193-da66c8897f49 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:12.614037 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b22944bb-8f20-4f98-a193-da66c8897f49 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:12.614479 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b22944bb-8f20-4f98-a193-da66c8897f49 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:12.624101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3ae81bcc-95d5-4c97-b7f2-fdbfea41be31 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:12.624602 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3ae81bcc-95d5-4c97-b7f2-fdbfea41be31 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:12.630550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3ae81bcc-95d5-4c97-b7f2-fdbfea41be31 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:12.631004 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3ae81bcc-95d5-4c97-b7f2-fdbfea41be31 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:12.631766 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3ae81bcc-95d5-4c97-b7f2-fdbfea41be31 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:12.632203 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3ae81bcc-95d5-4c97-b7f2-fdbfea41be31 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:12.656034 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3ae81bcc-95d5-4c97-b7f2-fdbfea41be31 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/ips" status: 200 len: 153 microversion: 2.20 time: 0.035640 Jul 29 11:48:12.656932 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 110/208] 10.222.0.60 () {60 vars in 1289 bytes} [Fri Jul 29 11:48:12 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/ips => generated 153 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 11:48:12.743495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-b22944bb-8f20-4f98-a193-da66c8897f49 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:12.750947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-b22944bb-8f20-4f98-a193-da66c8897f49 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.149476 Jul 29 11:48:12.751516 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 99/209] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:12 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:12.945022 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6ed969ca-a3c1-4481-9c15-db5e9a42bb71 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:12.945982 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6ed969ca-a3c1-4481-9c15-db5e9a42bb71 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:12.953541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6ed969ca-a3c1-4481-9c15-db5e9a42bb71 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:12.954074 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6ed969ca-a3c1-4481-9c15-db5e9a42bb71 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:12.954977 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6ed969ca-a3c1-4481-9c15-db5e9a42bb71 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:12.955418 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6ed969ca-a3c1-4481-9c15-db5e9a42bb71 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:12.959373 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=100 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:13.092002 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6ed969ca-a3c1-4481-9c15-db5e9a42bb71 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:13.099983 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-6ed969ca-a3c1-4481-9c15-db5e9a42bb71 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1315 microversion: 2.1 time: 0.158520 Jul 29 11:48:13.100556 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 111/210] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:12 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:13.247278 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-d5d753d7-2fd9-49bc-827c-d327c861c02f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:13.247895 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-d5d753d7-2fd9-49bc-827c-d327c861c02f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:13.253897 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d5d753d7-2fd9-49bc-827c-d327c861c02f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:13.254348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d5d753d7-2fd9-49bc-827c-d327c861c02f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:13.255108 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d5d753d7-2fd9-49bc-827c-d327c861c02f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:13.255548 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d5d753d7-2fd9-49bc-827c-d327c861c02f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:13.389786 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-d5d753d7-2fd9-49bc-827c-d327c861c02f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:13.397445 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-d5d753d7-2fd9-49bc-827c-d327c861c02f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.154510 Jul 29 11:48:13.398036 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 100/211] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:13 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:13.772330 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5f93b270-e9ea-4bc2-a0b2-262cb9efec1a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:13.772940 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-5f93b270-e9ea-4bc2-a0b2-262cb9efec1a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:13.778898 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5f93b270-e9ea-4bc2-a0b2-262cb9efec1a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:13.779346 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5f93b270-e9ea-4bc2-a0b2-262cb9efec1a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:13.780104 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5f93b270-e9ea-4bc2-a0b2-262cb9efec1a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:13.780541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5f93b270-e9ea-4bc2-a0b2-262cb9efec1a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:13.908518 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5f93b270-e9ea-4bc2-a0b2-262cb9efec1a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:13.916000 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-5f93b270-e9ea-4bc2-a0b2-262cb9efec1a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.147554 Jul 29 11:48:13.916575 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 112/212] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:13 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:14.121479 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6f472e3f-dfbb-47a8-9d73-b4920b9cc8fd tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:14.122031 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6f472e3f-dfbb-47a8-9d73-b4920b9cc8fd tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:14.128136 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6f472e3f-dfbb-47a8-9d73-b4920b9cc8fd tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:14.128580 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6f472e3f-dfbb-47a8-9d73-b4920b9cc8fd tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:14.129335 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6f472e3f-dfbb-47a8-9d73-b4920b9cc8fd tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:14.129791 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6f472e3f-dfbb-47a8-9d73-b4920b9cc8fd tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:14.263782 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6f472e3f-dfbb-47a8-9d73-b4920b9cc8fd tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:14.271271 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6f472e3f-dfbb-47a8-9d73-b4920b9cc8fd tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1315 microversion: 2.1 time: 0.154276 Jul 29 11:48:14.271837 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 101/213] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:14 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:14.418785 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-af4f1015-0ba3-4351-80cb-5997782f409c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:14.419357 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-af4f1015-0ba3-4351-80cb-5997782f409c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:14.425936 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-af4f1015-0ba3-4351-80cb-5997782f409c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:14.426390 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-af4f1015-0ba3-4351-80cb-5997782f409c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:14.427155 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-af4f1015-0ba3-4351-80cb-5997782f409c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:14.427597 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-af4f1015-0ba3-4351-80cb-5997782f409c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:14.559594 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-af4f1015-0ba3-4351-80cb-5997782f409c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:14.566968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-af4f1015-0ba3-4351-80cb-5997782f409c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.152594 Jul 29 11:48:14.567532 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 113/214] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:14 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:14.936579 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-2ed7fab6-bfcf-42e2-abc1-be8ae951aedb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:14.937181 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-2ed7fab6-bfcf-42e2-abc1-be8ae951aedb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:14.943133 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2ed7fab6-bfcf-42e2-abc1-be8ae951aedb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:14.943578 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2ed7fab6-bfcf-42e2-abc1-be8ae951aedb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:14.944323 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2ed7fab6-bfcf-42e2-abc1-be8ae951aedb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:14.944751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2ed7fab6-bfcf-42e2-abc1-be8ae951aedb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:15.078702 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-2ed7fab6-bfcf-42e2-abc1-be8ae951aedb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:15.086427 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-2ed7fab6-bfcf-42e2-abc1-be8ae951aedb tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.153706 Jul 29 11:48:15.087808 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 102/215] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:14 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:15.291737 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b0b37296-35db-4298-b045-268821911155 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:15.292362 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b0b37296-35db-4298-b045-268821911155 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:15.298366 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b0b37296-35db-4298-b045-268821911155 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:15.298813 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b0b37296-35db-4298-b045-268821911155 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:15.299570 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b0b37296-35db-4298-b045-268821911155 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:15.300010 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b0b37296-35db-4298-b045-268821911155 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:15.429964 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b0b37296-35db-4298-b045-268821911155 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:15.437972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b0b37296-35db-4298-b045-268821911155 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1315 microversion: 2.1 time: 0.150166 Jul 29 11:48:15.438534 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 114/216] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:15 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:15.588067 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e20296cc-0442-4319-9d3f-116ac50b18b6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:15.588677 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e20296cc-0442-4319-9d3f-116ac50b18b6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:15.594709 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e20296cc-0442-4319-9d3f-116ac50b18b6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:15.595158 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e20296cc-0442-4319-9d3f-116ac50b18b6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:15.595909 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e20296cc-0442-4319-9d3f-116ac50b18b6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:15.596343 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e20296cc-0442-4319-9d3f-116ac50b18b6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:15.723555 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e20296cc-0442-4319-9d3f-116ac50b18b6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:15.731055 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e20296cc-0442-4319-9d3f-116ac50b18b6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.146903 Jul 29 11:48:15.731619 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 103/217] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:15 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:16.107946 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b216c038-db87-4347-8f1b-eb46d24e59c6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:16.108564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b216c038-db87-4347-8f1b-eb46d24e59c6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:16.114568 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b216c038-db87-4347-8f1b-eb46d24e59c6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:16.115027 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b216c038-db87-4347-8f1b-eb46d24e59c6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:16.115788 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b216c038-db87-4347-8f1b-eb46d24e59c6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:16.116229 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b216c038-db87-4347-8f1b-eb46d24e59c6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:16.248601 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b216c038-db87-4347-8f1b-eb46d24e59c6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:16.256108 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b216c038-db87-4347-8f1b-eb46d24e59c6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.152043 Jul 29 11:48:16.256765 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 115/218] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:16 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:16.459075 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-26133f3c-7c28-4991-a4aa-534e23a711f5 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:16.459690 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-26133f3c-7c28-4991-a4aa-534e23a711f5 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:16.466078 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-26133f3c-7c28-4991-a4aa-534e23a711f5 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:16.466535 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-26133f3c-7c28-4991-a4aa-534e23a711f5 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:16.467301 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-26133f3c-7c28-4991-a4aa-534e23a711f5 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:16.467741 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-26133f3c-7c28-4991-a4aa-534e23a711f5 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:16.594328 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-26133f3c-7c28-4991-a4aa-534e23a711f5 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:16.601710 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-26133f3c-7c28-4991-a4aa-534e23a711f5 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1315 microversion: 2.1 time: 0.146403 Jul 29 11:48:16.602782 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 104/219] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:16 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:16.752074 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-43d7b79a-d70c-448c-8090-591a64dfeed5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:16.752692 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-43d7b79a-d70c-448c-8090-591a64dfeed5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:16.759934 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-43d7b79a-d70c-448c-8090-591a64dfeed5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:16.760387 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-43d7b79a-d70c-448c-8090-591a64dfeed5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:16.761153 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-43d7b79a-d70c-448c-8090-591a64dfeed5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:16.761869 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-43d7b79a-d70c-448c-8090-591a64dfeed5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:16.891438 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-43d7b79a-d70c-448c-8090-591a64dfeed5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:16.899821 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-43d7b79a-d70c-448c-8090-591a64dfeed5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.151013 Jul 29 11:48:16.900406 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 116/220] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:16 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:17.051954 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-d761c00a-02d4-4cec-99c0-20524c1f55bc req-f7014f92-4cb5-4197-bf18-497f3a43bd5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7529e35b-c6b2-4c8f-896c-fd2060f91657", "name": "network-vif-plugged", "status": "completed", "tag": "f123c03d-aaa7-4c59-a7db-11c40621e5c6"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:17.066161 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-d761c00a-02d4-4cec-99c0-20524c1f55bc req-f7014f92-4cb5-4197-bf18-497f3a43bd5c service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:17.066604 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-d761c00a-02d4-4cec-99c0-20524c1f55bc req-f7014f92-4cb5-4197-bf18-497f3a43bd5c service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:17.080423 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-d761c00a-02d4-4cec-99c0-20524c1f55bc req-f7014f92-4cb5-4197-bf18-497f3a43bd5c service nova] Creating event network-vif-plugged:f123c03d-aaa7-4c59-a7db-11c40621e5c6 for instance 7529e35b-c6b2-4c8f-896c-fd2060f91657 on hv-cinder-83754 Jul 29 11:48:17.086363 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-d761c00a-02d4-4cec-99c0-20524c1f55bc req-f7014f92-4cb5-4197-bf18-497f3a43bd5c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038076 Jul 29 11:48:17.087202 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 105/221] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:48:17.278279 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-32576347-68c6-4aac-b3d1-a9d5ebb48f3d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:17.278823 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-32576347-68c6-4aac-b3d1-a9d5ebb48f3d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:17.284938 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-32576347-68c6-4aac-b3d1-a9d5ebb48f3d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:17.285445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-32576347-68c6-4aac-b3d1-a9d5ebb48f3d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:17.286189 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-32576347-68c6-4aac-b3d1-a9d5ebb48f3d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:17.286625 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-32576347-68c6-4aac-b3d1-a9d5ebb48f3d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:17.423684 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-32576347-68c6-4aac-b3d1-a9d5ebb48f3d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:17.433155 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-32576347-68c6-4aac-b3d1-a9d5ebb48f3d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.158779 Jul 29 11:48:17.434506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 117/222] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:17 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:17.623011 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-2a0a504a-cc68-41ad-9e95-3098a42d443f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:17.623862 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-2a0a504a-cc68-41ad-9e95-3098a42d443f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:17.630123 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2a0a504a-cc68-41ad-9e95-3098a42d443f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:17.630571 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2a0a504a-cc68-41ad-9e95-3098a42d443f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:17.631329 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2a0a504a-cc68-41ad-9e95-3098a42d443f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:17.631763 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2a0a504a-cc68-41ad-9e95-3098a42d443f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:17.691078 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-76673e35-f3fe-433d-a778-0ba54365699f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:17.691981 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-76673e35-f3fe-433d-a778-0ba54365699f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:17.702556 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-76673e35-f3fe-433d-a778-0ba54365699f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:17.703408 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-76673e35-f3fe-433d-a778-0ba54365699f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:17.704416 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-76673e35-f3fe-433d-a778-0ba54365699f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:17.704954 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-76673e35-f3fe-433d-a778-0ba54365699f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:17.731824 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-76673e35-f3fe-433d-a778-0ba54365699f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lazy-loading 'flavor' on Instance uuid d7bd0b02-2726-4432-a6a1-53035c9a1978 {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:48:17.786986 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-2a0a504a-cc68-41ad-9e95-3098a42d443f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:17.797345 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-2a0a504a-cc68-41ad-9e95-3098a42d443f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1315 microversion: 2.1 time: 0.178370 Jul 29 11:48:17.798097 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 106/223] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:17 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:17.920969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-24866918-250f-4f3f-8eae-cff8fd74469b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:17.922149 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-24866918-250f-4f3f-8eae-cff8fd74469b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:17.928885 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-24866918-250f-4f3f-8eae-cff8fd74469b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:17.929342 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-24866918-250f-4f3f-8eae-cff8fd74469b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:17.930148 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-24866918-250f-4f3f-8eae-cff8fd74469b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:17.931919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-24866918-250f-4f3f-8eae-cff8fd74469b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:17.955073 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-76673e35-f3fe-433d-a778-0ba54365699f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "POST /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/action" status: 202 len: 0 microversion: 2.20 time: 0.269561 Jul 29 11:48:17.955814 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 118/224] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Jul 29 11:48:17 2022] POST /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:48:17.964484 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1a7633a3-9dbb-4667-9f54-6ed990e98dce tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:17.965239 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-1a7633a3-9dbb-4667-9f54-6ed990e98dce tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:17.971585 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1a7633a3-9dbb-4667-9f54-6ed990e98dce tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:17.972229 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1a7633a3-9dbb-4667-9f54-6ed990e98dce tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:17.973028 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1a7633a3-9dbb-4667-9f54-6ed990e98dce tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:17.973484 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1a7633a3-9dbb-4667-9f54-6ed990e98dce tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:18.072596 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-24866918-250f-4f3f-8eae-cff8fd74469b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:18.080751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-24866918-250f-4f3f-8eae-cff8fd74469b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.163702 Jul 29 11:48:18.081662 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 107/225] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:17 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:48:18.245268 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1a7633a3-9dbb-4667-9f54-6ed990e98dce tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:18.253124 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1a7633a3-9dbb-4667-9f54-6ed990e98dce tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:18.254654 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1a7633a3-9dbb-4667-9f54-6ed990e98dce tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:18.255813 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1a7633a3-9dbb-4667-9f54-6ed990e98dce tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.295821 Jul 29 11:48:18.256377 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 119/226] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:17 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:48:18.454660 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-1e1ad55d-8e22-49fd-b4b6-c1cb611bfdb2 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:18.455272 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-1e1ad55d-8e22-49fd-b4b6-c1cb611bfdb2 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:18.461323 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1e1ad55d-8e22-49fd-b4b6-c1cb611bfdb2 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:18.462589 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1e1ad55d-8e22-49fd-b4b6-c1cb611bfdb2 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:18.463657 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1e1ad55d-8e22-49fd-b4b6-c1cb611bfdb2 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:18.464100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1e1ad55d-8e22-49fd-b4b6-c1cb611bfdb2 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:18.596601 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-1e1ad55d-8e22-49fd-b4b6-c1cb611bfdb2 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:18.605134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-1e1ad55d-8e22-49fd-b4b6-c1cb611bfdb2 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.154296 Jul 29 11:48:18.613465 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 108/227] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:18 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:18.820094 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-bac31cb7-f80b-49f4-92e3-7cfe6f4b4f1b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:18.820637 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-bac31cb7-f80b-49f4-92e3-7cfe6f4b4f1b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:18.827700 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bac31cb7-f80b-49f4-92e3-7cfe6f4b4f1b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:18.828144 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bac31cb7-f80b-49f4-92e3-7cfe6f4b4f1b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:18.828890 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bac31cb7-f80b-49f4-92e3-7cfe6f4b4f1b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:18.829316 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bac31cb7-f80b-49f4-92e3-7cfe6f4b4f1b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:18.958940 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bac31cb7-f80b-49f4-92e3-7cfe6f4b4f1b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:18.967478 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-bac31cb7-f80b-49f4-92e3-7cfe6f4b4f1b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1315 microversion: 2.1 time: 0.151225 Jul 29 11:48:18.968252 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 120/228] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:18 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:19.102760 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c7261ce4-fbb9-4e10-a823-59a2c864fd90 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:19.103472 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-c7261ce4-fbb9-4e10-a823-59a2c864fd90 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:19.109670 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c7261ce4-fbb9-4e10-a823-59a2c864fd90 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:19.110117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c7261ce4-fbb9-4e10-a823-59a2c864fd90 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:19.110872 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c7261ce4-fbb9-4e10-a823-59a2c864fd90 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:19.111300 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c7261ce4-fbb9-4e10-a823-59a2c864fd90 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:19.243481 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-c7261ce4-fbb9-4e10-a823-59a2c864fd90 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:19.250963 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-c7261ce4-fbb9-4e10-a823-59a2c864fd90 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.152574 Jul 29 11:48:19.251531 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 109/229] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:19 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:19.278618 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d19f774b-3bc4-4261-a966-66fca9afa10e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:19.279218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d19f774b-3bc4-4261-a966-66fca9afa10e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:19.285154 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d19f774b-3bc4-4261-a966-66fca9afa10e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:19.285635 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d19f774b-3bc4-4261-a966-66fca9afa10e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:19.286386 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d19f774b-3bc4-4261-a966-66fca9afa10e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:19.286818 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d19f774b-3bc4-4261-a966-66fca9afa10e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:19.414746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d19f774b-3bc4-4261-a966-66fca9afa10e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:19.423191 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d19f774b-3bc4-4261-a966-66fca9afa10e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:19.424695 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d19f774b-3bc4-4261-a966-66fca9afa10e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:19.425887 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d19f774b-3bc4-4261-a966-66fca9afa10e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.151093 Jul 29 11:48:19.426444 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 121/230] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:19 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:19.626694 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6664061a-649e-4513-8546-a3c9eabf6b03 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:19.627241 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6664061a-649e-4513-8546-a3c9eabf6b03 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:19.633247 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6664061a-649e-4513-8546-a3c9eabf6b03 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:19.634029 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6664061a-649e-4513-8546-a3c9eabf6b03 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:19.634802 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6664061a-649e-4513-8546-a3c9eabf6b03 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:19.635241 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6664061a-649e-4513-8546-a3c9eabf6b03 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:19.765264 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6664061a-649e-4513-8546-a3c9eabf6b03 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:19.772626 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6664061a-649e-4513-8546-a3c9eabf6b03 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.149861 Jul 29 11:48:19.773194 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 110/231] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:19 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:19.987976 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b19850ad-34f9-4f11-9167-ba797bf93734 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:19.988620 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b19850ad-34f9-4f11-9167-ba797bf93734 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:19.995667 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b19850ad-34f9-4f11-9167-ba797bf93734 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:19.996121 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b19850ad-34f9-4f11-9167-ba797bf93734 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:19.996887 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b19850ad-34f9-4f11-9167-ba797bf93734 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:19.997328 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b19850ad-34f9-4f11-9167-ba797bf93734 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:20.127618 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b19850ad-34f9-4f11-9167-ba797bf93734 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:20.135698 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b19850ad-34f9-4f11-9167-ba797bf93734 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1315 microversion: 2.1 time: 0.151542 Jul 29 11:48:20.136506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 122/232] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:19 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:20.272514 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e6793e3c-16c0-4d05-80db-f5e342e63a31 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:20.273063 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e6793e3c-16c0-4d05-80db-f5e342e63a31 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:20.279599 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e6793e3c-16c0-4d05-80db-f5e342e63a31 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:20.280051 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e6793e3c-16c0-4d05-80db-f5e342e63a31 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:20.280810 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e6793e3c-16c0-4d05-80db-f5e342e63a31 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:20.281261 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e6793e3c-16c0-4d05-80db-f5e342e63a31 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:20.283885 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=100 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:20.410073 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e6793e3c-16c0-4d05-80db-f5e342e63a31 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:20.417724 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e6793e3c-16c0-4d05-80db-f5e342e63a31 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.149072 Jul 29 11:48:20.418292 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 111/233] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:20 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:20.449421 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-363dcc30-1e42-42e0-9988-f310a3a70f3d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:20.450054 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-363dcc30-1e42-42e0-9988-f310a3a70f3d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:20.455956 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-363dcc30-1e42-42e0-9988-f310a3a70f3d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:20.456399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-363dcc30-1e42-42e0-9988-f310a3a70f3d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:20.457153 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-363dcc30-1e42-42e0-9988-f310a3a70f3d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:20.457896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-363dcc30-1e42-42e0-9988-f310a3a70f3d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:20.588714 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-363dcc30-1e42-42e0-9988-f310a3a70f3d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:20.596547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-363dcc30-1e42-42e0-9988-f310a3a70f3d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:20.598077 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-363dcc30-1e42-42e0-9988-f310a3a70f3d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:20.599231 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-363dcc30-1e42-42e0-9988-f310a3a70f3d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.154266 Jul 29 11:48:20.599780 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 123/234] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:20 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:20.795505 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e6a9bc0c-3060-41bb-86c5-f80a68556553 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:20.796047 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e6a9bc0c-3060-41bb-86c5-f80a68556553 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:20.802000 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e6a9bc0c-3060-41bb-86c5-f80a68556553 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:20.802446 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e6a9bc0c-3060-41bb-86c5-f80a68556553 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:20.803200 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e6a9bc0c-3060-41bb-86c5-f80a68556553 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:20.803628 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e6a9bc0c-3060-41bb-86c5-f80a68556553 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:20.931071 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e6a9bc0c-3060-41bb-86c5-f80a68556553 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:20.938569 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e6a9bc0c-3060-41bb-86c5-f80a68556553 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.148729 Jul 29 11:48:20.939133 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 112/235] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:20 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:21.156153 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1add27e3-fd4f-4731-933b-83f06cf4ccfa tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:21.156765 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-1add27e3-fd4f-4731-933b-83f06cf4ccfa tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:21.163389 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1add27e3-fd4f-4731-933b-83f06cf4ccfa tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:21.163837 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1add27e3-fd4f-4731-933b-83f06cf4ccfa tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:21.165116 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1add27e3-fd4f-4731-933b-83f06cf4ccfa tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:21.165583 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1add27e3-fd4f-4731-933b-83f06cf4ccfa tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:21.316497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1add27e3-fd4f-4731-933b-83f06cf4ccfa tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:21.325373 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1add27e3-fd4f-4731-933b-83f06cf4ccfa tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1315 microversion: 2.1 time: 0.173105 Jul 29 11:48:21.325978 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 124/236] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:21 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:21.438452 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8075a51e-e063-4553-b59f-31396c59eca1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:21.439241 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8075a51e-e063-4553-b59f-31396c59eca1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:21.448052 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8075a51e-e063-4553-b59f-31396c59eca1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:21.448563 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8075a51e-e063-4553-b59f-31396c59eca1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:21.449374 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8075a51e-e063-4553-b59f-31396c59eca1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:21.449837 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8075a51e-e063-4553-b59f-31396c59eca1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:21.585479 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-8075a51e-e063-4553-b59f-31396c59eca1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:21.593289 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8075a51e-e063-4553-b59f-31396c59eca1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.158652 Jul 29 11:48:21.593892 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 113/237] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:21 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:21.622097 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-a3a94608-de31-4b6d-95e3-4561a500cd36 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:21.622968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-a3a94608-de31-4b6d-95e3-4561a500cd36 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:21.631892 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a3a94608-de31-4b6d-95e3-4561a500cd36 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:21.632719 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a3a94608-de31-4b6d-95e3-4561a500cd36 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:21.634290 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a3a94608-de31-4b6d-95e3-4561a500cd36 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:21.634716 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a3a94608-de31-4b6d-95e3-4561a500cd36 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:21.786584 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a3a94608-de31-4b6d-95e3-4561a500cd36 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:21.788894 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:21.798316 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a3a94608-de31-4b6d-95e3-4561a500cd36 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:21.800073 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a3a94608-de31-4b6d-95e3-4561a500cd36 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:21.801379 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-a3a94608-de31-4b6d-95e3-4561a500cd36 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.184112 Jul 29 11:48:21.802030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 125/238] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:21 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:21.960816 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9b86fa01-18ee-4964-a2a9-9026ef9797f8 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:21.962326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9b86fa01-18ee-4964-a2a9-9026ef9797f8 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:21.969522 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9b86fa01-18ee-4964-a2a9-9026ef9797f8 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:21.970882 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9b86fa01-18ee-4964-a2a9-9026ef9797f8 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:21.970882 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9b86fa01-18ee-4964-a2a9-9026ef9797f8 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:21.971207 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9b86fa01-18ee-4964-a2a9-9026ef9797f8 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:22.131902 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9b86fa01-18ee-4964-a2a9-9026ef9797f8 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:22.140951 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9b86fa01-18ee-4964-a2a9-9026ef9797f8 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1319 microversion: 2.1 time: 0.184782 Jul 29 11:48:22.141564 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 114/239] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:21 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:22.346953 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5334dd19-7fdf-4118-a7e4-9d1189bc2eb9 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:22.347639 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-5334dd19-7fdf-4118-a7e4-9d1189bc2eb9 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:22.355947 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5334dd19-7fdf-4118-a7e4-9d1189bc2eb9 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:22.356604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5334dd19-7fdf-4118-a7e4-9d1189bc2eb9 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:22.357316 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5334dd19-7fdf-4118-a7e4-9d1189bc2eb9 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:22.357788 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5334dd19-7fdf-4118-a7e4-9d1189bc2eb9 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:22.494420 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5334dd19-7fdf-4118-a7e4-9d1189bc2eb9 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:22.502095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-5334dd19-7fdf-4118-a7e4-9d1189bc2eb9 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1315 microversion: 2.1 time: 0.159358 Jul 29 11:48:22.502656 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 126/240] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:22 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:22.615385 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-b3443510-8fea-4b6c-959e-aaebc853a932 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:22.616003 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-b3443510-8fea-4b6c-959e-aaebc853a932 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:22.622613 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b3443510-8fea-4b6c-959e-aaebc853a932 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:22.623064 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b3443510-8fea-4b6c-959e-aaebc853a932 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:22.623833 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b3443510-8fea-4b6c-959e-aaebc853a932 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:22.624337 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b3443510-8fea-4b6c-959e-aaebc853a932 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:22.759635 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-b3443510-8fea-4b6c-959e-aaebc853a932 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:22.767653 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-b3443510-8fea-4b6c-959e-aaebc853a932 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.156336 Jul 29 11:48:22.768228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 115/241] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:22 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:22.825173 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e6309e37-9289-44fe-b674-3a7e990c718f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:22.825827 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e6309e37-9289-44fe-b674-3a7e990c718f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:22.831878 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e6309e37-9289-44fe-b674-3a7e990c718f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:22.832334 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e6309e37-9289-44fe-b674-3a7e990c718f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:22.833104 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e6309e37-9289-44fe-b674-3a7e990c718f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:22.833574 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e6309e37-9289-44fe-b674-3a7e990c718f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:22.963519 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e6309e37-9289-44fe-b674-3a7e990c718f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:22.971629 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e6309e37-9289-44fe-b674-3a7e990c718f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:22.973326 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e6309e37-9289-44fe-b674-3a7e990c718f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:22.974314 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e6309e37-9289-44fe-b674-3a7e990c718f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.153645 Jul 29 11:48:22.975051 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 127/242] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:22 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:23.136597 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-fb5b485d-5a35-4a13-8b56-d163f113d03e req-09f2d894-33dc-4b41-8fb2-981b83e1c0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b642f8-7f80-47f7-a283-ee2a69bdc693", "name": "network-vif-plugged", "status": "completed", "tag": "519417b3-986b-45dd-940a-074d514f506f"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:23.147479 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-fb5b485d-5a35-4a13-8b56-d163f113d03e req-09f2d894-33dc-4b41-8fb2-981b83e1c0bd service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:23.148203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-fb5b485d-5a35-4a13-8b56-d163f113d03e req-09f2d894-33dc-4b41-8fb2-981b83e1c0bd service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:23.161059 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-fb5b485d-5a35-4a13-8b56-d163f113d03e req-09f2d894-33dc-4b41-8fb2-981b83e1c0bd service nova] Creating event network-vif-plugged:519417b3-986b-45dd-940a-074d514f506f for instance d2b642f8-7f80-47f7-a283-ee2a69bdc693 on hv-cinder-83754 Jul 29 11:48:23.161830 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-0bc0f375-139e-4815-82c5-cb9ca12195d6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:23.162601 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-0bc0f375-139e-4815-82c5-cb9ca12195d6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:23.166672 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-fb5b485d-5a35-4a13-8b56-d163f113d03e req-09f2d894-33dc-4b41-8fb2-981b83e1c0bd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035404 Jul 29 11:48:23.167270 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 116/243] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:48:23.169401 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0bc0f375-139e-4815-82c5-cb9ca12195d6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:23.169883 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0bc0f375-139e-4815-82c5-cb9ca12195d6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:23.170653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0bc0f375-139e-4815-82c5-cb9ca12195d6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:23.171116 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0bc0f375-139e-4815-82c5-cb9ca12195d6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:23.316438 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-0bc0f375-139e-4815-82c5-cb9ca12195d6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:23.325241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-0bc0f375-139e-4815-82c5-cb9ca12195d6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1509 microversion: 2.1 time: 0.167710 Jul 29 11:48:23.325851 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 128/244] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:23 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:23.525211 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-90ce45b3-635b-4319-8b1a-a9cfec63848f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:23.526232 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-90ce45b3-635b-4319-8b1a-a9cfec63848f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:23.532700 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-90ce45b3-635b-4319-8b1a-a9cfec63848f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:23.533154 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-90ce45b3-635b-4319-8b1a-a9cfec63848f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:23.533957 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-90ce45b3-635b-4319-8b1a-a9cfec63848f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:23.534401 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-90ce45b3-635b-4319-8b1a-a9cfec63848f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:23.686841 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-90ce45b3-635b-4319-8b1a-a9cfec63848f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:23.695478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-90ce45b3-635b-4319-8b1a-a9cfec63848f tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1315 microversion: 2.1 time: 0.175358 Jul 29 11:48:23.696040 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 117/245] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:23 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:23.790704 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-84b3b798-c147-42ca-a02f-18f2ec723800 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:23.791448 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-84b3b798-c147-42ca-a02f-18f2ec723800 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:23.797579 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-84b3b798-c147-42ca-a02f-18f2ec723800 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:23.798240 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-84b3b798-c147-42ca-a02f-18f2ec723800 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:23.799211 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-84b3b798-c147-42ca-a02f-18f2ec723800 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:23.799810 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-84b3b798-c147-42ca-a02f-18f2ec723800 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:23.933721 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-84b3b798-c147-42ca-a02f-18f2ec723800 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:23.941430 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-84b3b798-c147-42ca-a02f-18f2ec723800 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.157065 Jul 29 11:48:23.941997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 129/246] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:23 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:23.999286 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-1a1b9caa-6168-4850-b677-f5214ad839af tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:23.999909 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-1a1b9caa-6168-4850-b677-f5214ad839af tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:24.006335 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1a1b9caa-6168-4850-b677-f5214ad839af tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:24.006678 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1a1b9caa-6168-4850-b677-f5214ad839af tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:24.007865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1a1b9caa-6168-4850-b677-f5214ad839af tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:24.008577 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1a1b9caa-6168-4850-b677-f5214ad839af tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:24.155725 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-1a1b9caa-6168-4850-b677-f5214ad839af tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:24.163506 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-1a1b9caa-6168-4850-b677-f5214ad839af tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:24.165039 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-1a1b9caa-6168-4850-b677-f5214ad839af tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:24.166221 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-1a1b9caa-6168-4850-b677-f5214ad839af tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.170858 Jul 29 11:48:24.166771 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 118/247] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:23 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:24.716815 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-381bd4be-c3fe-494d-bfcc-ff4e71afc847 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:24.717448 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-381bd4be-c3fe-494d-bfcc-ff4e71afc847 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:24.726456 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-381bd4be-c3fe-494d-bfcc-ff4e71afc847 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:24.727002 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-381bd4be-c3fe-494d-bfcc-ff4e71afc847 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:24.728759 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-381bd4be-c3fe-494d-bfcc-ff4e71afc847 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:24.729558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-381bd4be-c3fe-494d-bfcc-ff4e71afc847 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:24.899196 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-381bd4be-c3fe-494d-bfcc-ff4e71afc847 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:24.907258 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-381bd4be-c3fe-494d-bfcc-ff4e71afc847 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1315 microversion: 2.1 time: 0.194587 Jul 29 11:48:24.907845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 130/248] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:24 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:24.962968 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-0966fd7d-c34c-46f1-8cbc-97b754e81041 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:24.963571 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-0966fd7d-c34c-46f1-8cbc-97b754e81041 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:24.980868 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0966fd7d-c34c-46f1-8cbc-97b754e81041 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:24.981329 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0966fd7d-c34c-46f1-8cbc-97b754e81041 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:24.982251 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0966fd7d-c34c-46f1-8cbc-97b754e81041 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:24.982616 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0966fd7d-c34c-46f1-8cbc-97b754e81041 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:25.139222 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-0966fd7d-c34c-46f1-8cbc-97b754e81041 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:25.146992 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-0966fd7d-c34c-46f1-8cbc-97b754e81041 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.187786 Jul 29 11:48:25.147574 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 119/249] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:24 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:25.190212 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-12ac09c5-e9cf-4c8b-8b87-8523affe5969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:25.191106 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-12ac09c5-e9cf-4c8b-8b87-8523affe5969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:25.198458 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-12ac09c5-e9cf-4c8b-8b87-8523affe5969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:25.198910 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-12ac09c5-e9cf-4c8b-8b87-8523affe5969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:25.199684 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-12ac09c5-e9cf-4c8b-8b87-8523affe5969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:25.200154 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-12ac09c5-e9cf-4c8b-8b87-8523affe5969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:25.338605 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-12ac09c5-e9cf-4c8b-8b87-8523affe5969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:25.346527 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-12ac09c5-e9cf-4c8b-8b87-8523affe5969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:25.348023 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-12ac09c5-e9cf-4c8b-8b87-8523affe5969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:25.349196 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-12ac09c5-e9cf-4c8b-8b87-8523affe5969 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.163051 Jul 29 11:48:25.349768 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 131/250] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:25 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:25.934008 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-b22c9f1b-b4c7-429b-954d-25346a9166f4 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:25.934796 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-b22c9f1b-b4c7-429b-954d-25346a9166f4 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:25.941550 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b22c9f1b-b4c7-429b-954d-25346a9166f4 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:25.942119 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b22c9f1b-b4c7-429b-954d-25346a9166f4 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:25.942940 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b22c9f1b-b4c7-429b-954d-25346a9166f4 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:25.943400 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b22c9f1b-b4c7-429b-954d-25346a9166f4 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:26.121364 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-b22c9f1b-b4c7-429b-954d-25346a9166f4 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:26.130077 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-b22c9f1b-b4c7-429b-954d-25346a9166f4 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1465 microversion: 2.1 time: 0.200615 Jul 29 11:48:26.130567 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 120/251] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:25 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1465 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:26.169837 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-37782926-f45c-4c6d-9897-39557bd55f91 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:26.170668 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-37782926-f45c-4c6d-9897-39557bd55f91 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:26.183413 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9d590b1f-525f-4182-a5b8-8d220ca77c50 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:26.183954 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9d590b1f-525f-4182-a5b8-8d220ca77c50 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:26.186807 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-37782926-f45c-4c6d-9897-39557bd55f91 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:26.187648 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-37782926-f45c-4c6d-9897-39557bd55f91 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:26.188644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-37782926-f45c-4c6d-9897-39557bd55f91 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:26.189474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-37782926-f45c-4c6d-9897-39557bd55f91 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:26.198275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d590b1f-525f-4182-a5b8-8d220ca77c50 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:26.198989 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d590b1f-525f-4182-a5b8-8d220ca77c50 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:26.199922 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d590b1f-525f-4182-a5b8-8d220ca77c50 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:26.200365 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d590b1f-525f-4182-a5b8-8d220ca77c50 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:26.233831 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9d590b1f-525f-4182-a5b8-8d220ca77c50 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Going to try to terminate instance {{(pid=129585) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:48:26.338007 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9d590b1f-525f-4182-a5b8-8d220ca77c50 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 204 len: 0 microversion: 2.1 time: 0.159569 Jul 29 11:48:26.338954 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 121/252] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:48:26 2022] DELETE /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 11:48:26.349737 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-467ca8b2-aa9c-4f4a-9167-ffb55ae4ac2b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:26.351137 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-467ca8b2-aa9c-4f4a-9167-ffb55ae4ac2b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:26.361249 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-467ca8b2-aa9c-4f4a-9167-ffb55ae4ac2b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:26.362050 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-467ca8b2-aa9c-4f4a-9167-ffb55ae4ac2b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:26.362902 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-467ca8b2-aa9c-4f4a-9167-ffb55ae4ac2b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:26.363426 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-467ca8b2-aa9c-4f4a-9167-ffb55ae4ac2b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:26.378605 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-37782926-f45c-4c6d-9897-39557bd55f91 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:26.393223 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-37782926-f45c-4c6d-9897-39557bd55f91 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.228485 Jul 29 11:48:26.405516 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 132/253] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:26 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:26.405516 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1c138d95-c785-40b9-a398-06ab89b76fa2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:26.405516 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-1c138d95-c785-40b9-a398-06ab89b76fa2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:26.405516 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:26.413354 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1c138d95-c785-40b9-a398-06ab89b76fa2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:26.413838 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1c138d95-c785-40b9-a398-06ab89b76fa2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:26.415460 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1c138d95-c785-40b9-a398-06ab89b76fa2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:26.415829 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1c138d95-c785-40b9-a398-06ab89b76fa2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:26.597863 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-467ca8b2-aa9c-4f4a-9167-ffb55ae4ac2b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:26.607768 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-467ca8b2-aa9c-4f4a-9167-ffb55ae4ac2b tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1471 microversion: 2.1 time: 0.264079 Jul 29 11:48:26.614169 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1c138d95-c785-40b9-a398-06ab89b76fa2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:26.618769 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 122/254] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:26 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1471 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:48:26.624567 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1c138d95-c785-40b9-a398-06ab89b76fa2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:26.626271 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1c138d95-c785-40b9-a398-06ab89b76fa2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:26.627731 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1c138d95-c785-40b9-a398-06ab89b76fa2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.232103 Jul 29 11:48:26.628303 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 133/255] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:26 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:27.416162 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c748934c-0ee1-4657-80e9-128b85cbfd8e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:27.416779 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-c748934c-0ee1-4657-80e9-128b85cbfd8e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:27.422794 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c748934c-0ee1-4657-80e9-128b85cbfd8e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:27.423368 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c748934c-0ee1-4657-80e9-128b85cbfd8e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:27.424344 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c748934c-0ee1-4657-80e9-128b85cbfd8e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:27.424844 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c748934c-0ee1-4657-80e9-128b85cbfd8e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:27.616225 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-c748934c-0ee1-4657-80e9-128b85cbfd8e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:27.624436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-c748934c-0ee1-4657-80e9-128b85cbfd8e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.212143 Jul 29 11:48:27.625130 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 123/256] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:27 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:27.640747 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-815b5205-c57c-466c-a3af-f2782088bc9d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:27.641364 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-815b5205-c57c-466c-a3af-f2782088bc9d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:27.647909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-815b5205-c57c-466c-a3af-f2782088bc9d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:27.648358 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-815b5205-c57c-466c-a3af-f2782088bc9d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:27.649329 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-815b5205-c57c-466c-a3af-f2782088bc9d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:27.649989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-815b5205-c57c-466c-a3af-f2782088bc9d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:27.652452 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-561c36d1-c068-485c-91df-8fd74dea4873 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:27.653320 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-561c36d1-c068-485c-91df-8fd74dea4873 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:27.659969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-561c36d1-c068-485c-91df-8fd74dea4873 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:27.660427 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-561c36d1-c068-485c-91df-8fd74dea4873 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:27.661240 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-561c36d1-c068-485c-91df-8fd74dea4873 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:27.661711 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-561c36d1-c068-485c-91df-8fd74dea4873 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:27.912860 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-815b5205-c57c-466c-a3af-f2782088bc9d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:27.925486 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-561c36d1-c068-485c-91df-8fd74dea4873 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:27.926796 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-815b5205-c57c-466c-a3af-f2782088bc9d tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1471 microversion: 2.1 time: 0.290061 Jul 29 11:48:27.937172 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-561c36d1-c068-485c-91df-8fd74dea4873 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:27.938549 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 134/257] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:27 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1471 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:27.949785 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-561c36d1-c068-485c-91df-8fd74dea4873 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:27.951090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-561c36d1-c068-485c-91df-8fd74dea4873 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.302840 Jul 29 11:48:27.951740 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 124/258] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:27 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:28.544628 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-b9cac3e7-b5b7-46b0-b928-f71114678f3c req-e2cd4d90-a04f-4132-87bd-54a4579f87e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b642f8-7f80-47f7-a283-ee2a69bdc693", "name": "network-vif-deleted", "tag": "519417b3-986b-45dd-940a-074d514f506f"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:28.560059 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-b9cac3e7-b5b7-46b0-b928-f71114678f3c req-e2cd4d90-a04f-4132-87bd-54a4579f87e8 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:28.560510 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-b9cac3e7-b5b7-46b0-b928-f71114678f3c req-e2cd4d90-a04f-4132-87bd-54a4579f87e8 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:28.578281 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-b9cac3e7-b5b7-46b0-b928-f71114678f3c req-e2cd4d90-a04f-4132-87bd-54a4579f87e8 service nova] Creating event network-vif-deleted:519417b3-986b-45dd-940a-074d514f506f for instance d2b642f8-7f80-47f7-a283-ee2a69bdc693 on hv-cinder-83754 Jul 29 11:48:28.584212 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-b9cac3e7-b5b7-46b0-b928-f71114678f3c req-e2cd4d90-a04f-4132-87bd-54a4579f87e8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044026 Jul 29 11:48:28.585241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 135/259] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:48:28.648589 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4939c1f7-f2db-4494-abeb-293f3f82be6e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:28.649880 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4939c1f7-f2db-4494-abeb-293f3f82be6e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:28.658300 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4939c1f7-f2db-4494-abeb-293f3f82be6e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:28.659040 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4939c1f7-f2db-4494-abeb-293f3f82be6e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:28.659984 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4939c1f7-f2db-4494-abeb-293f3f82be6e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:28.660578 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4939c1f7-f2db-4494-abeb-293f3f82be6e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:28.815923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-4939c1f7-f2db-4494-abeb-293f3f82be6e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:28.824228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4939c1f7-f2db-4494-abeb-293f3f82be6e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.180327 Jul 29 11:48:28.824794 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 125/260] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:28 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:28.952180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-92f0d4c3-e263-49e6-9649-544288a56041 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:28.952877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-92f0d4c3-e263-49e6-9649-544288a56041 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:28.959084 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-92f0d4c3-e263-49e6-9649-544288a56041 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:28.959536 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-92f0d4c3-e263-49e6-9649-544288a56041 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:28.960297 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-92f0d4c3-e263-49e6-9649-544288a56041 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:28.960736 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-92f0d4c3-e263-49e6-9649-544288a56041 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:28.976545 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-fb68c228-9949-4d9e-b112-688582b22bdf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:28.977157 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-fb68c228-9949-4d9e-b112-688582b22bdf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:28.983206 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fb68c228-9949-4d9e-b112-688582b22bdf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:28.983659 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fb68c228-9949-4d9e-b112-688582b22bdf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:28.984425 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fb68c228-9949-4d9e-b112-688582b22bdf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:28.984861 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fb68c228-9949-4d9e-b112-688582b22bdf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:28.992931 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-92f0d4c3-e263-49e6-9649-544288a56041 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:28.993377 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-92f0d4c3-e263-49e6-9649-544288a56041 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:28.993856 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-92f0d4c3-e263-49e6-9649-544288a56041 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lazy-loading 'fault' on Instance uuid d2b642f8-7f80-47f7-a283-ee2a69bdc693 {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:48:29.065698 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-92f0d4c3-e263-49e6-9649-544288a56041 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1af73fd4ac487fac1568cb445a511d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460961ebb939469c96621850ab00bd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:29.075678 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-92f0d4c3-e263-49e6-9649-544288a56041 tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 200 len: 1305 microversion: 2.1 time: 0.128886 Jul 29 11:48:29.076482 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 136/261] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:28 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 1305 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:29.140156 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fb68c228-9949-4d9e-b112-688582b22bdf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:29.142814 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:29.150773 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fb68c228-9949-4d9e-b112-688582b22bdf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:29.152282 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fb68c228-9949-4d9e-b112-688582b22bdf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:29.153471 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-fb68c228-9949-4d9e-b112-688582b22bdf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.180811 Jul 29 11:48:29.154180 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 126/262] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:28 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:48:29.845039 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-46ecd037-4828-40f3-af0c-9d8db76fe7f5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:29.845618 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-46ecd037-4828-40f3-af0c-9d8db76fe7f5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:29.851600 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-46ecd037-4828-40f3-af0c-9d8db76fe7f5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:29.852051 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-46ecd037-4828-40f3-af0c-9d8db76fe7f5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:29.852815 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-46ecd037-4828-40f3-af0c-9d8db76fe7f5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:29.853256 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-46ecd037-4828-40f3-af0c-9d8db76fe7f5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:29.995817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-46ecd037-4828-40f3-af0c-9d8db76fe7f5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:30.003402 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-46ecd037-4828-40f3-af0c-9d8db76fe7f5 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.162395 Jul 29 11:48:30.004312 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 137/263] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:29 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:30.096219 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e93df9b1-8289-4111-8382-6c710c9fcade tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:30.096779 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e93df9b1-8289-4111-8382-6c710c9fcade tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] [instance: d2b642f8-7f80-47f7-a283-ee2a69bdc693] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:30.100287 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:30.106413 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e93df9b1-8289-4111-8382-6c710c9fcade tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:30.106865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e93df9b1-8289-4111-8382-6c710c9fcade tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:30.107642 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e93df9b1-8289-4111-8382-6c710c9fcade tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:30.108143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e93df9b1-8289-4111-8382-6c710c9fcade tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:30.122781 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-e93df9b1-8289-4111-8382-6c710c9fcade tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] HTTP exception thrown: Instance d2b642f8-7f80-47f7-a283-ee2a69bdc693 could not be found. Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e93df9b1-8289-4111-8382-6c710c9fcade tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Request method failure captured: Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 HTTP/1.1 Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48jsOgIPz5Bq_sxXYCI5lH3rl8YHwEEt_-t-stW0WFRshmQLhjNV8NCwzcT1chX4QxJwnppkXkbyxDwNtcwduoKutkf6S1W-bcuGMR2wghoSRlurYT1HOg_oL4_l_xYB5HELO25GBdWaSpTTqkGqETeeQlL0h-Bou_7Qtc3EplRBAeE Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 460961ebb939469c96621850ab00bd8e Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-VolumesNegativeTest-1239145956 Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:48:30.124585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:48:30.125971 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/460961ebb939469c96621850ab00bd8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_460961ebb939469c96621850ab00bd8e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/460961ebb939469c96621850ab00bd8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/460961ebb939469c96621850ab00bd8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:48:30.125971 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-VolumesNegativeTest-1239145956 Jul 29 11:48:30.125971 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 460961ebb939469c96621850ab00bd8e Jul 29 11:48:30.125971 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-VolumesNegativeTest-1239145956 Jul 29 11:48:30.125971 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-VolumesNegativeTest-1239145956-project Jul 29 11:48:30.125971 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:48:30.125971 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:48:30.125971 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: eb1af73fd4ac487fac1568cb445a511d Jul 29 11:48:30.125971 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-VolumesNegativeTest-1239145956-project Jul 29 11:48:30.125971 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:48:30.125971 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance d2b642f8-7f80-47f7-a283-ee2a69bdc693 could not be found. Jul 29 11:48:30.125971 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': 'd2b642f8-7f80-47f7-a283-ee2a69bdc693'} Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b642f8-7f80-47f7-a283-ee2a69bdc693 could not be found. Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:48:30.128140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b642f8-7f80-47f7-a283-ee2a69bdc693 could not be found. Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b642f8-7f80-47f7-a283-ee2a69bdc693 could not be found. Jul 29 11:48:30.129744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:48:30.130963 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e93df9b1-8289-4111-8382-6c710c9fcade tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] Returning 404 to user: Instance d2b642f8-7f80-47f7-a283-ee2a69bdc693 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:48:30.130963 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e93df9b1-8289-4111-8382-6c710c9fcade tempest-VolumesNegativeTest-1239145956 tempest-VolumesNegativeTest-1239145956-project] 10.222.0.60 "GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693" status: 404 len: 111 microversion: 2.1 time: 0.034003 Jul 29 11:48:30.130963 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 127/264] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:30 2022] GET /compute/v2.1/servers/d2b642f8-7f80-47f7-a283-ee2a69bdc693 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:48:30.176198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ce1afcf2-f957-4e83-8249-c386a57f3d45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:30.176944 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ce1afcf2-f957-4e83-8249-c386a57f3d45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:30.183931 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ce1afcf2-f957-4e83-8249-c386a57f3d45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:30.184552 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ce1afcf2-f957-4e83-8249-c386a57f3d45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:30.185374 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ce1afcf2-f957-4e83-8249-c386a57f3d45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:30.185865 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ce1afcf2-f957-4e83-8249-c386a57f3d45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:30.336688 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ce1afcf2-f957-4e83-8249-c386a57f3d45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:30.345540 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ce1afcf2-f957-4e83-8249-c386a57f3d45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:30.347113 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ce1afcf2-f957-4e83-8249-c386a57f3d45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:30.348220 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ce1afcf2-f957-4e83-8249-c386a57f3d45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.176030 Jul 29 11:48:30.348799 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 138/265] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:30 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:31.024787 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5f877d87-4695-4536-9fa9-84e3353b6cbf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:31.025665 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-5f877d87-4695-4536-9fa9-84e3353b6cbf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:31.035124 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5f877d87-4695-4536-9fa9-84e3353b6cbf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:31.035611 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5f877d87-4695-4536-9fa9-84e3353b6cbf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:31.036392 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5f877d87-4695-4536-9fa9-84e3353b6cbf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:31.036834 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5f877d87-4695-4536-9fa9-84e3353b6cbf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:31.175993 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-5f877d87-4695-4536-9fa9-84e3353b6cbf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:31.185846 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-5f877d87-4695-4536-9fa9-84e3353b6cbf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.165253 Jul 29 11:48:31.187231 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 128/266] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:31 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:48:31.370703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-949a65c2-30b1-4680-ae1c-72e5e079f020 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:31.371398 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-949a65c2-30b1-4680-ae1c-72e5e079f020 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:31.378050 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-949a65c2-30b1-4680-ae1c-72e5e079f020 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:31.378498 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-949a65c2-30b1-4680-ae1c-72e5e079f020 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:31.379301 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-949a65c2-30b1-4680-ae1c-72e5e079f020 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:31.379706 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-949a65c2-30b1-4680-ae1c-72e5e079f020 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:31.516844 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-949a65c2-30b1-4680-ae1c-72e5e079f020 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:31.526547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-949a65c2-30b1-4680-ae1c-72e5e079f020 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:31.528280 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-949a65c2-30b1-4680-ae1c-72e5e079f020 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:31.529509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-949a65c2-30b1-4680-ae1c-72e5e079f020 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.162679 Jul 29 11:48:31.530140 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 139/267] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:31 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:32.207238 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-76168306-d4a2-45f4-beba-7b9fb67b0d19 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:32.207859 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-76168306-d4a2-45f4-beba-7b9fb67b0d19 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:32.214349 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-76168306-d4a2-45f4-beba-7b9fb67b0d19 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:32.214808 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-76168306-d4a2-45f4-beba-7b9fb67b0d19 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:32.215587 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-76168306-d4a2-45f4-beba-7b9fb67b0d19 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:32.216029 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-76168306-d4a2-45f4-beba-7b9fb67b0d19 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:32.362053 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-76168306-d4a2-45f4-beba-7b9fb67b0d19 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:32.371251 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-76168306-d4a2-45f4-beba-7b9fb67b0d19 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.167233 Jul 29 11:48:32.371951 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 129/268] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:32 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:32.552335 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-fe81f0b1-549a-457e-b593-9ee659c78215 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:32.552947 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-fe81f0b1-549a-457e-b593-9ee659c78215 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:32.560274 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fe81f0b1-549a-457e-b593-9ee659c78215 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:32.560736 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fe81f0b1-549a-457e-b593-9ee659c78215 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:32.561646 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fe81f0b1-549a-457e-b593-9ee659c78215 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:32.561977 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fe81f0b1-549a-457e-b593-9ee659c78215 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:32.709069 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-fe81f0b1-549a-457e-b593-9ee659c78215 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:32.718118 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-fe81f0b1-549a-457e-b593-9ee659c78215 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:32.719926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-fe81f0b1-549a-457e-b593-9ee659c78215 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:32.721312 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-fe81f0b1-549a-457e-b593-9ee659c78215 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.172712 Jul 29 11:48:32.722079 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 140/269] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:32 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:33.392614 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-d44251e4-5d08-4a73-aaa8-c96f3608ed58 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:33.393223 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-d44251e4-5d08-4a73-aaa8-c96f3608ed58 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:33.399256 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d44251e4-5d08-4a73-aaa8-c96f3608ed58 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:33.399708 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d44251e4-5d08-4a73-aaa8-c96f3608ed58 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:33.400461 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d44251e4-5d08-4a73-aaa8-c96f3608ed58 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:33.400899 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d44251e4-5d08-4a73-aaa8-c96f3608ed58 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:33.532292 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-d44251e4-5d08-4a73-aaa8-c96f3608ed58 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:33.540197 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-d44251e4-5d08-4a73-aaa8-c96f3608ed58 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.151399 Jul 29 11:48:33.540782 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 130/270] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:33 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:33.744519 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-991c0e7b-4ba8-4000-99ae-253692d54e4f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:33.745039 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-991c0e7b-4ba8-4000-99ae-253692d54e4f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:33.752214 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-991c0e7b-4ba8-4000-99ae-253692d54e4f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:33.752662 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-991c0e7b-4ba8-4000-99ae-253692d54e4f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:33.753446 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-991c0e7b-4ba8-4000-99ae-253692d54e4f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:33.753871 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-991c0e7b-4ba8-4000-99ae-253692d54e4f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:33.882511 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-991c0e7b-4ba8-4000-99ae-253692d54e4f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:33.890787 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-991c0e7b-4ba8-4000-99ae-253692d54e4f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:33.892476 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-991c0e7b-4ba8-4000-99ae-253692d54e4f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:33.894173 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-991c0e7b-4ba8-4000-99ae-253692d54e4f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.153458 Jul 29 11:48:33.894861 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 141/271] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:33 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:34.562544 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-d9fc5786-f91c-424b-b151-672aca292174 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:34.569280 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-d9fc5786-f91c-424b-b151-672aca292174 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:34.582999 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d9fc5786-f91c-424b-b151-672aca292174 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:34.583491 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d9fc5786-f91c-424b-b151-672aca292174 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:34.585146 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d9fc5786-f91c-424b-b151-672aca292174 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:34.585626 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d9fc5786-f91c-424b-b151-672aca292174 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:34.735332 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-d9fc5786-f91c-424b-b151-672aca292174 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:34.745140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-d9fc5786-f91c-424b-b151-672aca292174 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.188052 Jul 29 11:48:34.746086 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 131/272] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:34 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:34.917511 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-92d4ad7f-ce43-4407-8ac1-a14f68e68157 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:34.918257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-92d4ad7f-ce43-4407-8ac1-a14f68e68157 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:34.924745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-92d4ad7f-ce43-4407-8ac1-a14f68e68157 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:34.925195 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-92d4ad7f-ce43-4407-8ac1-a14f68e68157 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:34.925990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-92d4ad7f-ce43-4407-8ac1-a14f68e68157 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:34.926425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-92d4ad7f-ce43-4407-8ac1-a14f68e68157 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:35.059495 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-92d4ad7f-ce43-4407-8ac1-a14f68e68157 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:35.061857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=100 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:35.069264 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-92d4ad7f-ce43-4407-8ac1-a14f68e68157 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:35.070811 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-92d4ad7f-ce43-4407-8ac1-a14f68e68157 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:35.072061 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-92d4ad7f-ce43-4407-8ac1-a14f68e68157 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.158515 Jul 29 11:48:35.072614 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 142/273] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:34 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:35.767646 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-bcc3e98c-9159-4588-84e7-e37528bca7d2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:35.768173 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-bcc3e98c-9159-4588-84e7-e37528bca7d2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:35.774271 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bcc3e98c-9159-4588-84e7-e37528bca7d2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:35.774719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bcc3e98c-9159-4588-84e7-e37528bca7d2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:35.775484 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bcc3e98c-9159-4588-84e7-e37528bca7d2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:35.775920 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bcc3e98c-9159-4588-84e7-e37528bca7d2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:35.904977 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-bcc3e98c-9159-4588-84e7-e37528bca7d2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:35.912606 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-bcc3e98c-9159-4588-84e7-e37528bca7d2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.148958 Jul 29 11:48:35.913172 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 132/274] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:35 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:36.096409 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c9d38f3a-7bb8-4ea9-9a2d-ef149614ba71 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:36.096942 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c9d38f3a-7bb8-4ea9-9a2d-ef149614ba71 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:36.103158 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c9d38f3a-7bb8-4ea9-9a2d-ef149614ba71 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:36.103608 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c9d38f3a-7bb8-4ea9-9a2d-ef149614ba71 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:36.104378 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c9d38f3a-7bb8-4ea9-9a2d-ef149614ba71 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:36.104885 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c9d38f3a-7bb8-4ea9-9a2d-ef149614ba71 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:36.235008 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c9d38f3a-7bb8-4ea9-9a2d-ef149614ba71 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:36.243082 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c9d38f3a-7bb8-4ea9-9a2d-ef149614ba71 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:36.244588 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c9d38f3a-7bb8-4ea9-9a2d-ef149614ba71 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:36.245806 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c9d38f3a-7bb8-4ea9-9a2d-ef149614ba71 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.153469 Jul 29 11:48:36.246375 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 143/275] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:36 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:36.934656 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-31341d4d-9d48-4811-b5a1-fdb4ab8179f6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:36.935273 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-31341d4d-9d48-4811-b5a1-fdb4ab8179f6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:36.941408 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-31341d4d-9d48-4811-b5a1-fdb4ab8179f6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:36.941900 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-31341d4d-9d48-4811-b5a1-fdb4ab8179f6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:36.942668 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-31341d4d-9d48-4811-b5a1-fdb4ab8179f6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:36.943106 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-31341d4d-9d48-4811-b5a1-fdb4ab8179f6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:37.072409 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-31341d4d-9d48-4811-b5a1-fdb4ab8179f6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:37.080054 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-31341d4d-9d48-4811-b5a1-fdb4ab8179f6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1502 microversion: 2.1 time: 0.149875 Jul 29 11:48:37.080618 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 133/276] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:36 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:37.100642 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6d2665af-e269-4627-bb74-f1e71e074c87 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fcd38b3-cd8c-4485-83eb-5b5539c5c520"}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:37.103122 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6d2665af-e269-4627-bb74-f1e71e074c87 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:37.110427 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6d2665af-e269-4627-bb74-f1e71e074c87 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:37.110880 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6d2665af-e269-4627-bb74-f1e71e074c87 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:37.111654 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6d2665af-e269-4627-bb74-f1e71e074c87 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:37.112096 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6d2665af-e269-4627-bb74-f1e71e074c87 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:37.135221 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-6d2665af-e269-4627-bb74-f1e71e074c87 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] HTTP exception thrown: Cannot 'attach_volume' instance 8e39f512-b616-4e06-9f81-f853454d67aa while it is in vm_state rescued Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6d2665af-e269-4627-bb74-f1e71e074c87 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Request method failure captured: Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: POST /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa/os-volume_attachments HTTP/1.1 Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 74 Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48icWNF5VduBTIvjMx74oGekPjDM_WyPKfDFEqTnYbP9pmMYJ3iVEIhDcbFTI1aIEBtbuMVZ512qIJ9lmpywo_t0j8JU4KEV9fFpkjZDe9V6y8DrRt8ODhPkRG0qurIOC8MLkMcQJ5L6wWkf-02BMuHwG4Gsjsp_xiI86N4-AN7FChY Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 106664c99e9c4a0d9a9c9c05e08a3d7f Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1574150610 Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:48:37.137550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:48:37.138989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/106664c99e9c4a0d9a9c9c05e08a3d7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_106664c99e9c4a0d9a9c9c05e08a3d7f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/106664c99e9c4a0d9a9c9c05e08a3d7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/106664c99e9c4a0d9a9c9c05e08a3d7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:48:37.138989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1574150610 Jul 29 11:48:37.138989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 106664c99e9c4a0d9a9c9c05e08a3d7f Jul 29 11:48:37.138989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1574150610 Jul 29 11:48:37.138989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-ServerRescueNegativeTestJSON-1574150610-project Jul 29 11:48:37.138989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:48:37.138989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:48:37.138989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 9d341bba8dda445ca4eac6d52aa9f80c Jul 29 11:48:37.138989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1574150610-project Jul 29 11:48:37.138989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Jul 29 11:48:37.138989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {"volumeAttachment": {"volumeId": "8fcd38b3-cd8c-4485-83eb-5b5539c5c520"}} Jul 29 11:48:37.138989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Cannot 'attach_volume' instance 8e39f512-b616-4e06-9f81-f853454d67aa while it is in vm_state rescued Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'server_id': '8e39f512-b616-4e06-9f81-f853454d67aa', 'body': {'volumeAttachment': {'volumeId': '8fcd38b3-cd8c-4485-83eb-5b5539c5c520'}}} Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8e39f512-b616-4e06-9f81-f853454d67aa in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:48:37.139793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8e39f512-b616-4e06-9f81-f853454d67aa while it is in vm_state rescued Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:48:37.141062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:48:37.142528 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:48:37.142528 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:48:37.142528 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8e39f512-b616-4e06-9f81-f853454d67aa while it is in vm_state rescued Jul 29 11:48:37.142528 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:48:37.142528 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6d2665af-e269-4627-bb74-f1e71e074c87 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Returning 409 to user: Cannot 'attach_volume' instance 8e39f512-b616-4e06-9f81-f853454d67aa while it is in vm_state rescued {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:48:37.142528 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-6d2665af-e269-4627-bb74-f1e71e074c87 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "POST /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042317 Jul 29 11:48:37.142528 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 144/277] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Jul 29 11:48:37 2022] POST /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 29 11:48:37.147946 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-fbc6d214-d9b8-4043-83a4-0e4201406f2c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:37.148484 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-fbc6d214-d9b8-4043-83a4-0e4201406f2c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:37.155017 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fbc6d214-d9b8-4043-83a4-0e4201406f2c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:37.155467 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fbc6d214-d9b8-4043-83a4-0e4201406f2c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:37.156231 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fbc6d214-d9b8-4043-83a4-0e4201406f2c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:37.156666 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fbc6d214-d9b8-4043-83a4-0e4201406f2c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:37.221863 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-fbc6d214-d9b8-4043-83a4-0e4201406f2c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "POST /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa/action" status: 202 len: 0 microversion: 2.1 time: 0.077505 Jul 29 11:48:37.222517 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 134/278] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Jul 29 11:48:37 2022] POST /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:48:37.232289 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-55949884-7ee4-47f4-b60d-828830b806a8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:37.232903 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-55949884-7ee4-47f4-b60d-828830b806a8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:37.239089 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-55949884-7ee4-47f4-b60d-828830b806a8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:37.239578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-55949884-7ee4-47f4-b60d-828830b806a8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:37.240486 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-55949884-7ee4-47f4-b60d-828830b806a8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:37.240987 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-55949884-7ee4-47f4-b60d-828830b806a8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:37.269647 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-b8dc0ca2-c259-41e9-81ef-c7ab33043ed6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:37.270342 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-b8dc0ca2-c259-41e9-81ef-c7ab33043ed6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:37.277346 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b8dc0ca2-c259-41e9-81ef-c7ab33043ed6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:37.277861 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b8dc0ca2-c259-41e9-81ef-c7ab33043ed6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:37.278696 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b8dc0ca2-c259-41e9-81ef-c7ab33043ed6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:37.279138 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b8dc0ca2-c259-41e9-81ef-c7ab33043ed6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:37.664795 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-55949884-7ee4-47f4-b60d-828830b806a8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:37.672521 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-55949884-7ee4-47f4-b60d-828830b806a8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1510 microversion: 2.1 time: 0.445631 Jul 29 11:48:37.686153 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 145/279] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:37 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1510 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:37.703213 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-b8dc0ca2-c259-41e9-81ef-c7ab33043ed6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:37.712397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-b8dc0ca2-c259-41e9-81ef-c7ab33043ed6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:37.714806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-b8dc0ca2-c259-41e9-81ef-c7ab33043ed6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:37.717003 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-b8dc0ca2-c259-41e9-81ef-c7ab33043ed6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1745 microversion: 2.20 time: 0.451677 Jul 29 11:48:37.717803 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 135/280] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:37 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1745 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:48:38.692525 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-374e6195-3724-4025-bfff-e06c21708c8b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:38.693174 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-374e6195-3724-4025-bfff-e06c21708c8b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:38.699919 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-374e6195-3724-4025-bfff-e06c21708c8b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:38.700373 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-374e6195-3724-4025-bfff-e06c21708c8b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:38.701253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-374e6195-3724-4025-bfff-e06c21708c8b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:38.701721 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-374e6195-3724-4025-bfff-e06c21708c8b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:38.739995 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-621b5777-0eb1-48b1-a276-a87a185a12b4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:38.740606 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-621b5777-0eb1-48b1-a276-a87a185a12b4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:38.746939 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-621b5777-0eb1-48b1-a276-a87a185a12b4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:38.747392 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-621b5777-0eb1-48b1-a276-a87a185a12b4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:38.748190 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-621b5777-0eb1-48b1-a276-a87a185a12b4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:38.748623 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-621b5777-0eb1-48b1-a276-a87a185a12b4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:38.882939 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-374e6195-3724-4025-bfff-e06c21708c8b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:38.890715 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-374e6195-3724-4025-bfff-e06c21708c8b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1510 microversion: 2.1 time: 0.202026 Jul 29 11:48:38.891284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 146/281] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:38 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:38.909373 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-621b5777-0eb1-48b1-a276-a87a185a12b4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:38.917243 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-621b5777-0eb1-48b1-a276-a87a185a12b4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:38.919361 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-621b5777-0eb1-48b1-a276-a87a185a12b4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:38.920773 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-621b5777-0eb1-48b1-a276-a87a185a12b4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1745 microversion: 2.20 time: 0.184556 Jul 29 11:48:38.921327 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 136/282] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:38 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:48:39.415432 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4e58d5a4-e009-440a-b224-0f40d2429da8 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:39.415924 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-4e58d5a4-e009-440a-b224-0f40d2429da8 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:39.422151 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4e58d5a4-e009-440a-b224-0f40d2429da8 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:39.422596 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4e58d5a4-e009-440a-b224-0f40d2429da8 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:39.423357 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4e58d5a4-e009-440a-b224-0f40d2429da8 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:39.423787 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4e58d5a4-e009-440a-b224-0f40d2429da8 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:39.447114 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-4e58d5a4-e009-440a-b224-0f40d2429da8 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90/ips" status: 200 len: 150 microversion: 2.1 time: 0.035470 Jul 29 11:48:39.447685 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 147/283] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Jul 29 11:48:39 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:48:39.912178 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a33bc6fe-fc4c-4073-aa73-0fb2f6447921 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:39.912727 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a33bc6fe-fc4c-4073-aa73-0fb2f6447921 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:39.919361 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a33bc6fe-fc4c-4073-aa73-0fb2f6447921 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:39.919814 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a33bc6fe-fc4c-4073-aa73-0fb2f6447921 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:39.920588 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a33bc6fe-fc4c-4073-aa73-0fb2f6447921 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:39.921041 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a33bc6fe-fc4c-4073-aa73-0fb2f6447921 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:39.943385 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1051469f-6c6f-48a4-a4b4-7b86704f1e79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:39.944165 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-1051469f-6c6f-48a4-a4b4-7b86704f1e79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:39.950735 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1051469f-6c6f-48a4-a4b4-7b86704f1e79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:39.951191 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1051469f-6c6f-48a4-a4b4-7b86704f1e79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:39.951967 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1051469f-6c6f-48a4-a4b4-7b86704f1e79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:39.952409 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1051469f-6c6f-48a4-a4b4-7b86704f1e79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:40.104189 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a33bc6fe-fc4c-4073-aa73-0fb2f6447921 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:40.113796 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a33bc6fe-fc4c-4073-aa73-0fb2f6447921 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1510 microversion: 2.1 time: 0.205463 Jul 29 11:48:40.114469 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 137/284] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:39 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:40.127353 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1051469f-6c6f-48a4-a4b4-7b86704f1e79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:40.135951 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1051469f-6c6f-48a4-a4b4-7b86704f1e79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:40.137984 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1051469f-6c6f-48a4-a4b4-7b86704f1e79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:40.139146 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1051469f-6c6f-48a4-a4b4-7b86704f1e79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1745 microversion: 2.20 time: 0.199696 Jul 29 11:48:40.139695 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 148/285] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:39 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1745 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:48:40.811433 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-f612add4-e0b1-4835-926c-d1351805b378 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c076fb95-2396-4068-961f-ac8cd0459596"}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:40.813914 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-f612add4-e0b1-4835-926c-d1351805b378 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:40.819919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f612add4-e0b1-4835-926c-d1351805b378 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:40.820368 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f612add4-e0b1-4835-926c-d1351805b378 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:40.821121 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f612add4-e0b1-4835-926c-d1351805b378 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:40.821592 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f612add4-e0b1-4835-926c-d1351805b378 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:41.135339 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5f807a51-0d04-4c28-b584-e02a2058fd8e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:41.135948 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-5f807a51-0d04-4c28-b584-e02a2058fd8e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:41.143239 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5f807a51-0d04-4c28-b584-e02a2058fd8e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:41.143698 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5f807a51-0d04-4c28-b584-e02a2058fd8e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:41.144609 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5f807a51-0d04-4c28-b584-e02a2058fd8e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:41.145052 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5f807a51-0d04-4c28-b584-e02a2058fd8e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:41.196655 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-f612add4-e0b1-4835-926c-d1351805b378 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "POST /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389099 Jul 29 11:48:41.203747 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 138/286] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Jul 29 11:48:40 2022] POST /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:48:41.224470 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-bca8ac5d-b398-48d2-8d85-9d5c0d1b4863 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:41.225199 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-bca8ac5d-b398-48d2-8d85-9d5c0d1b4863 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:41.235742 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bca8ac5d-b398-48d2-8d85-9d5c0d1b4863 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:41.236200 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bca8ac5d-b398-48d2-8d85-9d5c0d1b4863 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:41.236985 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bca8ac5d-b398-48d2-8d85-9d5c0d1b4863 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:41.237475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bca8ac5d-b398-48d2-8d85-9d5c0d1b4863 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:41.330745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5f807a51-0d04-4c28-b584-e02a2058fd8e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:41.339726 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-5f807a51-0d04-4c28-b584-e02a2058fd8e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1516 microversion: 2.1 time: 0.208511 Jul 29 11:48:41.340927 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 149/287] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:41 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:48:41.345858 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-df859403-978e-40c1-b49d-a5c9de262bf3 req-b796552b-bd77-43d6-9b5e-8ed4509cd522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7bd0b02-2726-4432-a6a1-53035c9a1978", "name": "network-vif-plugged", "status": "completed", "tag": "fb1642b2-a468-43c6-8233-7e7bcc25cfcd"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:41.366222 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-df859403-978e-40c1-b49d-a5c9de262bf3 req-b796552b-bd77-43d6-9b5e-8ed4509cd522 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:41.366839 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-df859403-978e-40c1-b49d-a5c9de262bf3 req-b796552b-bd77-43d6-9b5e-8ed4509cd522 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:41.382317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-df859403-978e-40c1-b49d-a5c9de262bf3 req-b796552b-bd77-43d6-9b5e-8ed4509cd522 service nova] Creating event network-vif-plugged:fb1642b2-a468-43c6-8233-7e7bcc25cfcd for instance d7bd0b02-2726-4432-a6a1-53035c9a1978 on hv-cinder-83754 Jul 29 11:48:41.391904 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-df859403-978e-40c1-b49d-a5c9de262bf3 req-b796552b-bd77-43d6-9b5e-8ed4509cd522 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049271 Jul 29 11:48:41.401469 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 150/288] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:48:41.452410 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-bca8ac5d-b398-48d2-8d85-9d5c0d1b4863 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:41.460668 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-bca8ac5d-b398-48d2-8d85-9d5c0d1b4863 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:41.462351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-bca8ac5d-b398-48d2-8d85-9d5c0d1b4863 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:41.466021 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-bca8ac5d-b398-48d2-8d85-9d5c0d1b4863 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1745 microversion: 2.20 time: 0.248792 Jul 29 11:48:41.469497 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 139/289] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:41 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1745 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:41.788439 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e098973c-1e44-4569-8755-5f65a2ff3ac3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f565fa53-400e-43c9-9b0f-cd291ba242b1", "device": "/dev/sdb"}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:41.791387 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e098973c-1e44-4569-8755-5f65a2ff3ac3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:41.798591 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e098973c-1e44-4569-8755-5f65a2ff3ac3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:41.799104 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e098973c-1e44-4569-8755-5f65a2ff3ac3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:41.799909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e098973c-1e44-4569-8755-5f65a2ff3ac3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:41.800353 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e098973c-1e44-4569-8755-5f65a2ff3ac3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:42.066301 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e098973c-1e44-4569-8755-5f65a2ff3ac3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "POST /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282057 Jul 29 11:48:42.067248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 151/290] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Jul 29 11:48:41 2022] POST /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:48:42.492003 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9379a475-16ef-45a2-bd81-95652e1d5c60 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:42.494073 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9379a475-16ef-45a2-bd81-95652e1d5c60 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:42.502645 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9379a475-16ef-45a2-bd81-95652e1d5c60 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:42.503605 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9379a475-16ef-45a2-bd81-95652e1d5c60 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:42.504459 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9379a475-16ef-45a2-bd81-95652e1d5c60 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:42.504890 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9379a475-16ef-45a2-bd81-95652e1d5c60 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:42.668351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9379a475-16ef-45a2-bd81-95652e1d5c60 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:42.678186 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9379a475-16ef-45a2-bd81-95652e1d5c60 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:42.679695 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9379a475-16ef-45a2-bd81-95652e1d5c60 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:42.681321 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9379a475-16ef-45a2-bd81-95652e1d5c60 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1740 microversion: 2.20 time: 0.195896 Jul 29 11:48:42.691737 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 140/291] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:42 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:42.748838 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3b5835f5-1cae-4215-93a6-649efdf3cf23 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Action: 'create', calling method: .version_select at 0x7f68fa327790>, body: {"keypair": {"name": "tempest-keypair-1174795307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWf3t9CknugSDvICNnufHfUBx7bBCIVYdXUCHodIXCo0CA8HLyLifxJnZj/lotw6APEy8ddHgJ/PbiJ4mBdFWWmsc+LCxcrpk4AsUpGgYk4AIie7vrJNNkdyfC6CvgYJg=="}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:42.765132 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-3b5835f5-1cae-4215-93a6-649efdf3cf23 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Getting quotas for project 106664c99e9c4a0d9a9c9c05e08a3d7f. Resources: {'key_pairs'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:48:42.769500 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-3b5835f5-1cae-4215-93a6-649efdf3cf23 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Getting quotas for user 9d341bba8dda445ca4eac6d52aa9f80c and project 106664c99e9c4a0d9a9c9c05e08a3d7f. Resources: {'key_pairs'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:48:42.795831 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3b5835f5-1cae-4215-93a6-649efdf3cf23 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052208 Jul 29 11:48:42.802323 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 152/292] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Jul 29 11:48:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:48:43.705437 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-f1c0a3bd-a17a-4854-994e-4d3a4f5dda40 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:43.706660 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-f1c0a3bd-a17a-4854-994e-4d3a4f5dda40 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:43.714192 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f1c0a3bd-a17a-4854-994e-4d3a4f5dda40 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:43.714933 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f1c0a3bd-a17a-4854-994e-4d3a4f5dda40 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:43.716619 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f1c0a3bd-a17a-4854-994e-4d3a4f5dda40 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:43.717274 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f1c0a3bd-a17a-4854-994e-4d3a4f5dda40 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:44.109321 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-f1c0a3bd-a17a-4854-994e-4d3a4f5dda40 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:44.112508 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:44.124896 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-f1c0a3bd-a17a-4854-994e-4d3a4f5dda40 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:44.126830 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-f1c0a3bd-a17a-4854-994e-4d3a4f5dda40 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:44.128268 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-f1c0a3bd-a17a-4854-994e-4d3a4f5dda40 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1740 microversion: 2.20 time: 0.427067 Jul 29 11:48:44.129063 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 141/293] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:43 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1740 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:44.500073 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5c42d306-1108-478d-822b-661ac8e93bdb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1619175270", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4303157a-2669-4080-b15b-7be339c78e2e"}], "security_groups": [{"name": "tempest-securitygroup--728881659"}], "key_name": "tempest-keypair-1174795307", "user_data": "}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:44.614933 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.network.neutron [None req-5c42d306-1108-478d-822b-661ac8e93bdb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] validate_networks() for [('4303157a-2669-4080-b15b-7be339c78e2e', None, None, None, None, None)] {{(pid=129584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:48:45.037584 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-5c42d306-1108-478d-822b-661ac8e93bdb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Flavor limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:48:45.038100 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-5c42d306-1108-478d-822b-661ac8e93bdb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Image limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:48:45.038644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-5c42d306-1108-478d-822b-661ac8e93bdb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Flavor pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:48:45.039121 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-5c42d306-1108-478d-822b-661ac8e93bdb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Image pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:48:45.039617 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-5c42d306-1108-478d-822b-661ac8e93bdb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:48:45.050017 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5c42d306-1108-478d-822b-661ac8e93bdb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:45.050465 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5c42d306-1108-478d-822b-661ac8e93bdb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:45.051258 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5c42d306-1108-478d-822b-661ac8e93bdb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:45.051687 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5c42d306-1108-478d-822b-661ac8e93bdb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:45.085010 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-5c42d306-1108-478d-822b-661ac8e93bdb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Getting quotas for project 106664c99e9c4a0d9a9c9c05e08a3d7f. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:48:45.089695 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-5c42d306-1108-478d-822b-661ac8e93bdb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Getting quotas for user 9d341bba8dda445ca4eac6d52aa9f80c and project 106664c99e9c4a0d9a9c9c05e08a3d7f. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:48:45.102906 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-5c42d306-1108-478d-822b-661ac8e93bdb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Going to run 1 instances... {{(pid=129584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:48:45.105317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-5c42d306-1108-478d-822b-661ac8e93bdb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:48:45.159098 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6edc86a1-fe16-43d1-bf4c-c910518082d4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:45.160086 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6edc86a1-fe16-43d1-bf4c-c910518082d4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:45.174093 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6edc86a1-fe16-43d1-bf4c-c910518082d4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:45.174854 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6edc86a1-fe16-43d1-bf4c-c910518082d4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:45.175792 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6edc86a1-fe16-43d1-bf4c-c910518082d4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:45.176380 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6edc86a1-fe16-43d1-bf4c-c910518082d4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:45.186158 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-5c42d306-1108-478d-822b-661ac8e93bdb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.691868 Jul 29 11:48:45.187043 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 153/294] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:48:44 2022] POST /compute/v2.1/servers => generated 408 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 11:48:45.229746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b7e12927-feee-4882-8ddd-4a35f8a6546a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:45.230425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b7e12927-feee-4882-8ddd-4a35f8a6546a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:45.353342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b7e12927-feee-4882-8ddd-4a35f8a6546a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:45.361279 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b7e12927-feee-4882-8ddd-4a35f8a6546a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1246 microversion: 2.1 time: 0.135511 Jul 29 11:48:45.365384 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 154/295] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:45 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1246 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:45.460025 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6edc86a1-fe16-43d1-bf4c-c910518082d4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:45.471720 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6edc86a1-fe16-43d1-bf4c-c910518082d4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:45.473510 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6edc86a1-fe16-43d1-bf4c-c910518082d4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:45.474766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6edc86a1-fe16-43d1-bf4c-c910518082d4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1740 microversion: 2.20 time: 0.322796 Jul 29 11:48:45.475502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 142/296] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:45 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1740 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:46.387790 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3dbc7bdf-86ae-48d8-97c3-d819a99bb0de tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:46.388267 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3dbc7bdf-86ae-48d8-97c3-d819a99bb0de tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:46.406028 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3dbc7bdf-86ae-48d8-97c3-d819a99bb0de tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:46.407100 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3dbc7bdf-86ae-48d8-97c3-d819a99bb0de tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:46.408074 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3dbc7bdf-86ae-48d8-97c3-d819a99bb0de tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:46.408663 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3dbc7bdf-86ae-48d8-97c3-d819a99bb0de tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:46.486654 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3dbc7bdf-86ae-48d8-97c3-d819a99bb0de tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:46.499528 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e1c2b189-8dc4-4c5c-a1ad-f8683d8d1c30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:46.500427 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e1c2b189-8dc4-4c5c-a1ad-f8683d8d1c30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:46.507121 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3dbc7bdf-86ae-48d8-97c3-d819a99bb0de tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1298 microversion: 2.1 time: 0.123326 Jul 29 11:48:46.512729 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e1c2b189-8dc4-4c5c-a1ad-f8683d8d1c30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:46.513180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 155/297] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:46 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:46.513822 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e1c2b189-8dc4-4c5c-a1ad-f8683d8d1c30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:46.514757 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e1c2b189-8dc4-4c5c-a1ad-f8683d8d1c30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:46.515360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e1c2b189-8dc4-4c5c-a1ad-f8683d8d1c30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:46.710079 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e1c2b189-8dc4-4c5c-a1ad-f8683d8d1c30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:46.718750 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e1c2b189-8dc4-4c5c-a1ad-f8683d8d1c30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:46.720549 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e1c2b189-8dc4-4c5c-a1ad-f8683d8d1c30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:46.722317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e1c2b189-8dc4-4c5c-a1ad-f8683d8d1c30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1740 microversion: 2.20 time: 0.226702 Jul 29 11:48:46.738398 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 143/298] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:46 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:48:47.531923 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-17950345-7e5b-4fba-8a04-b8f3ff5002c8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:47.534021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-17950345-7e5b-4fba-8a04-b8f3ff5002c8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:47.541480 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-17950345-7e5b-4fba-8a04-b8f3ff5002c8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:47.542017 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-17950345-7e5b-4fba-8a04-b8f3ff5002c8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:47.542995 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-17950345-7e5b-4fba-8a04-b8f3ff5002c8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:47.556324 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-17950345-7e5b-4fba-8a04-b8f3ff5002c8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:47.748755 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-579e47ef-59a1-4e19-b667-0377032dd7cc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:47.750044 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-579e47ef-59a1-4e19-b667-0377032dd7cc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:47.765222 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-579e47ef-59a1-4e19-b667-0377032dd7cc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:47.772734 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-579e47ef-59a1-4e19-b667-0377032dd7cc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:47.772918 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-17950345-7e5b-4fba-8a04-b8f3ff5002c8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:47.776278 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-579e47ef-59a1-4e19-b667-0377032dd7cc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:47.778695 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-579e47ef-59a1-4e19-b667-0377032dd7cc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:47.782387 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-17950345-7e5b-4fba-8a04-b8f3ff5002c8 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1371 microversion: 2.1 time: 0.254859 Jul 29 11:48:47.782980 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 156/299] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:47 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:47.956149 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-579e47ef-59a1-4e19-b667-0377032dd7cc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:47.965636 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-579e47ef-59a1-4e19-b667-0377032dd7cc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:47.967213 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-579e47ef-59a1-4e19-b667-0377032dd7cc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:47.968603 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-579e47ef-59a1-4e19-b667-0377032dd7cc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1740 microversion: 2.20 time: 0.224849 Jul 29 11:48:47.969888 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 144/300] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:47 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:48.528848 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-a981ea73-b677-4f63-80a5-1d22e4b5d364 req-6ce2575f-f739-4ac0-9f14-7d18b8c630eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b4f838-c329-43d2-8448-82ad1ee8ad2a", "tag": "666ba69f-5b53-402b-9db5-8013b146c1da"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:48.550625 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-a981ea73-b677-4f63-80a5-1d22e4b5d364 req-6ce2575f-f739-4ac0-9f14-7d18b8c630eb service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:48.551343 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-a981ea73-b677-4f63-80a5-1d22e4b5d364 req-6ce2575f-f739-4ac0-9f14-7d18b8c630eb service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:48.566687 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-a981ea73-b677-4f63-80a5-1d22e4b5d364 req-6ce2575f-f739-4ac0-9f14-7d18b8c630eb service nova] Creating event network-changed:666ba69f-5b53-402b-9db5-8013b146c1da for instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a on hv-cinder-83754 Jul 29 11:48:48.572695 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-a981ea73-b677-4f63-80a5-1d22e4b5d364 req-6ce2575f-f739-4ac0-9f14-7d18b8c630eb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050960 Jul 29 11:48:48.573298 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 157/301] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:48:48.810057 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e37ce3c3-2b8a-43e1-9091-6e514cc10a37 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:48.811420 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e37ce3c3-2b8a-43e1-9091-6e514cc10a37 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:48.818199 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e37ce3c3-2b8a-43e1-9091-6e514cc10a37 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:48.818932 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e37ce3c3-2b8a-43e1-9091-6e514cc10a37 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:48.821464 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e37ce3c3-2b8a-43e1-9091-6e514cc10a37 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:48.822269 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e37ce3c3-2b8a-43e1-9091-6e514cc10a37 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:48.993006 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f71991ad-712e-47b5-9367-ab989be7c8b2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:48.994106 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f71991ad-712e-47b5-9367-ab989be7c8b2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:49.005333 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f71991ad-712e-47b5-9367-ab989be7c8b2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:49.009680 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f71991ad-712e-47b5-9367-ab989be7c8b2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:49.010754 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f71991ad-712e-47b5-9367-ab989be7c8b2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:49.011657 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f71991ad-712e-47b5-9367-ab989be7c8b2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:49.033595 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e37ce3c3-2b8a-43e1-9091-6e514cc10a37 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:49.043559 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e37ce3c3-2b8a-43e1-9091-6e514cc10a37 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1371 microversion: 2.1 time: 0.238040 Jul 29 11:48:49.044760 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 145/302] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:48 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:49.049728 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ea4f5659-8bb7-46a3-abbb-fa2eb8367983 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Action: 'create', calling method: .version_select at 0x7f68fa15f430>, body: {"keypair": {"name": "tempest-keypair-558765569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBzXYJhOwiCqhTvQ6wntaEA0PScvwsW+TC9eN5gKRkP9H58cW/wqb5k6dC4lVY/kWCiCxTssNZUxfx3yk0SgpjA5DWpsmRyaEjbGzsnKeYxR6MXGXT/Cl+TvD0Jay4e3Q=="}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:49.066742 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-ea4f5659-8bb7-46a3-abbb-fa2eb8367983 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Getting quotas for project 6a4b9969357142bc8724804eb47e0c48. Resources: {'key_pairs'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:48:49.071666 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-ea4f5659-8bb7-46a3-abbb-fa2eb8367983 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Getting quotas for user 1a343996462b462d86fb89b876f4e127 and project 6a4b9969357142bc8724804eb47e0c48. Resources: {'key_pairs'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:48:49.100930 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ea4f5659-8bb7-46a3-abbb-fa2eb8367983 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054819 Jul 29 11:48:49.109283 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 146/303] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Jul 29 11:48:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:48:49.186193 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f71991ad-712e-47b5-9367-ab989be7c8b2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:49.196108 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f71991ad-712e-47b5-9367-ab989be7c8b2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:49.197938 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f71991ad-712e-47b5-9367-ab989be7c8b2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:49.199134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f71991ad-712e-47b5-9367-ab989be7c8b2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1740 microversion: 2.20 time: 0.210579 Jul 29 11:48:49.199727 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 158/304] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:48 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:50.064692 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-94f22f88-0431-4e34-8a11-4ba4e7be6ef4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:50.065312 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-94f22f88-0431-4e34-8a11-4ba4e7be6ef4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:50.078620 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-94f22f88-0431-4e34-8a11-4ba4e7be6ef4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:50.079791 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-94f22f88-0431-4e34-8a11-4ba4e7be6ef4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:50.081246 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-94f22f88-0431-4e34-8a11-4ba4e7be6ef4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:50.082007 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-94f22f88-0431-4e34-8a11-4ba4e7be6ef4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:50.228305 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9b5105fe-fea3-4aaa-9523-4d2e2078dacf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:50.230244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-9b5105fe-fea3-4aaa-9523-4d2e2078dacf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:50.252005 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-94f22f88-0431-4e34-8a11-4ba4e7be6ef4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:50.262669 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-94f22f88-0431-4e34-8a11-4ba4e7be6ef4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1371 microversion: 2.1 time: 0.201678 Jul 29 11:48:50.263815 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9b5105fe-fea3-4aaa-9523-4d2e2078dacf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:50.265519 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9b5105fe-fea3-4aaa-9523-4d2e2078dacf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:50.266431 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9b5105fe-fea3-4aaa-9523-4d2e2078dacf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:50.270409 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9b5105fe-fea3-4aaa-9523-4d2e2078dacf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:50.271187 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 147/305] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:50 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:50.455243 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-9b5105fe-fea3-4aaa-9523-4d2e2078dacf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:50.464422 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-9b5105fe-fea3-4aaa-9523-4d2e2078dacf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:50.466621 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-9b5105fe-fea3-4aaa-9523-4d2e2078dacf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:50.468061 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-9b5105fe-fea3-4aaa-9523-4d2e2078dacf tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1740 microversion: 2.20 time: 0.245581 Jul 29 11:48:50.482134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 159/306] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:50 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1740 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:51.116510 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4709c47b-e3eb-43d2-80ad-61159488bac7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1458300799", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8c1956d-5393-448f-8fc5-93aafd4768ba"}], "security_groups": [{"name": "tempest-securitygroup--1617578439"}], "key_name": "tempest-keypair-558765569", "user_data": "}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:51.291940 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-8b448e80-5f8e-40c8-aee6-6986cd4352e6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:51.293821 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-8b448e80-5f8e-40c8-aee6-6986cd4352e6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:51.301711 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8b448e80-5f8e-40c8-aee6-6986cd4352e6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:51.303130 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.network.neutron [None req-4709c47b-e3eb-43d2-80ad-61159488bac7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] validate_networks() for [('b8c1956d-5393-448f-8fc5-93aafd4768ba', None, None, None, None, None)] {{(pid=129585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:48:51.306815 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8b448e80-5f8e-40c8-aee6-6986cd4352e6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:51.307911 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8b448e80-5f8e-40c8-aee6-6986cd4352e6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:51.311819 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8b448e80-5f8e-40c8-aee6-6986cd4352e6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:51.601561 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-8b448e80-5f8e-40c8-aee6-6986cd4352e6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:51.612052 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-8b448e80-5f8e-40c8-aee6-6986cd4352e6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1371 microversion: 2.1 time: 0.323734 Jul 29 11:48:51.613293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 160/307] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:51 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1371 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:48:51.618516 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4d08e7e2-549a-481d-97cd-363eb823ecd2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:51.619125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-4d08e7e2-549a-481d-97cd-363eb823ecd2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:51.630819 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4d08e7e2-549a-481d-97cd-363eb823ecd2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:51.631277 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4d08e7e2-549a-481d-97cd-363eb823ecd2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:51.632064 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4d08e7e2-549a-481d-97cd-363eb823ecd2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:51.632508 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4d08e7e2-549a-481d-97cd-363eb823ecd2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:51.938977 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4d08e7e2-549a-481d-97cd-363eb823ecd2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:51.951362 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4d08e7e2-549a-481d-97cd-363eb823ecd2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:51.953658 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4d08e7e2-549a-481d-97cd-363eb823ecd2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:51.955063 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-4d08e7e2-549a-481d-97cd-363eb823ecd2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1740 microversion: 2.20 time: 0.340657 Jul 29 11:48:51.969916 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 161/308] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:51 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1740 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:51.990067 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-4709c47b-e3eb-43d2-80ad-61159488bac7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Flavor limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:48:51.990705 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-4709c47b-e3eb-43d2-80ad-61159488bac7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Image limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:48:51.991354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-4709c47b-e3eb-43d2-80ad-61159488bac7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Flavor pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:48:51.991936 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-4709c47b-e3eb-43d2-80ad-61159488bac7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Image pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:48:51.992345 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-4709c47b-e3eb-43d2-80ad-61159488bac7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:48:52.001149 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4709c47b-e3eb-43d2-80ad-61159488bac7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:52.001628 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4709c47b-e3eb-43d2-80ad-61159488bac7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:52.002425 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4709c47b-e3eb-43d2-80ad-61159488bac7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:52.005636 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4709c47b-e3eb-43d2-80ad-61159488bac7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:52.024860 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-4709c47b-e3eb-43d2-80ad-61159488bac7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Getting quotas for project 6a4b9969357142bc8724804eb47e0c48. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:48:52.029905 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-4709c47b-e3eb-43d2-80ad-61159488bac7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Getting quotas for user 1a343996462b462d86fb89b876f4e127 and project 6a4b9969357142bc8724804eb47e0c48. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:48:52.041740 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4709c47b-e3eb-43d2-80ad-61159488bac7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Going to run 1 instances... {{(pid=129585) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:48:52.044873 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4709c47b-e3eb-43d2-80ad-61159488bac7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:48:52.099269 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4709c47b-e3eb-43d2-80ad-61159488bac7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.987192 Jul 29 11:48:52.100171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 148/309] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:48:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 11:48:52.113106 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b8b0a8bc-f3fc-4c65-b9bc-7ce0184ac174 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:52.114167 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b8b0a8bc-f3fc-4c65-b9bc-7ce0184ac174 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:52.173033 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b8b0a8bc-f3fc-4c65-b9bc-7ce0184ac174 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:52.181561 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b8b0a8bc-f3fc-4c65-b9bc-7ce0184ac174 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1241 microversion: 2.1 time: 0.073418 Jul 29 11:48:52.198767 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 162/310] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:52 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:52.638906 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-254e6540-5da1-4e7a-81c3-5f8d6f33a355 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:52.639580 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-254e6540-5da1-4e7a-81c3-5f8d6f33a355 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:52.647271 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-254e6540-5da1-4e7a-81c3-5f8d6f33a355 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:52.647842 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-254e6540-5da1-4e7a-81c3-5f8d6f33a355 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:52.648667 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-254e6540-5da1-4e7a-81c3-5f8d6f33a355 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:52.649181 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-254e6540-5da1-4e7a-81c3-5f8d6f33a355 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:52.787384 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-254e6540-5da1-4e7a-81c3-5f8d6f33a355 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:52.794994 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-254e6540-5da1-4e7a-81c3-5f8d6f33a355 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1371 microversion: 2.1 time: 0.164610 Jul 29 11:48:52.795551 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 149/311] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:52 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:52.978447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ae7de844-f3b8-4449-aa00-d6e554ef5725 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:52.979061 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ae7de844-f3b8-4449-aa00-d6e554ef5725 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:52.986207 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ae7de844-f3b8-4449-aa00-d6e554ef5725 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:52.986672 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ae7de844-f3b8-4449-aa00-d6e554ef5725 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:52.987427 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ae7de844-f3b8-4449-aa00-d6e554ef5725 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:52.987860 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ae7de844-f3b8-4449-aa00-d6e554ef5725 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:53.119167 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ae7de844-f3b8-4449-aa00-d6e554ef5725 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:53.122269 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:53.129598 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ae7de844-f3b8-4449-aa00-d6e554ef5725 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:53.131111 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ae7de844-f3b8-4449-aa00-d6e554ef5725 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:53.132356 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ae7de844-f3b8-4449-aa00-d6e554ef5725 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1740 microversion: 2.20 time: 0.157714 Jul 29 11:48:53.132911 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 163/312] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:52 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:53.203822 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a990496a-158f-48ec-a176-cd3ac9bd9bad tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:53.204440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a990496a-158f-48ec-a176-cd3ac9bd9bad tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:53.210478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a990496a-158f-48ec-a176-cd3ac9bd9bad tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:53.210932 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a990496a-158f-48ec-a176-cd3ac9bd9bad tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:53.211705 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a990496a-158f-48ec-a176-cd3ac9bd9bad tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:53.212137 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a990496a-158f-48ec-a176-cd3ac9bd9bad tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:53.273502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a990496a-158f-48ec-a176-cd3ac9bd9bad tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:53.281961 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a990496a-158f-48ec-a176-cd3ac9bd9bad tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1293 microversion: 2.1 time: 0.082402 Jul 29 11:48:53.282537 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 150/313] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:53 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:53.317211 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-47337bd6-113c-44df-aaa5-f10fd1320107 req-105271be-5214-4c9b-b265-508200d31306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b4f838-c329-43d2-8448-82ad1ee8ad2a", "name": "network-vif-plugged", "status": "completed", "tag": "666ba69f-5b53-402b-9db5-8013b146c1da"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:53.336567 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-47337bd6-113c-44df-aaa5-f10fd1320107 req-105271be-5214-4c9b-b265-508200d31306 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:53.337294 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-47337bd6-113c-44df-aaa5-f10fd1320107 req-105271be-5214-4c9b-b265-508200d31306 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:53.352588 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-47337bd6-113c-44df-aaa5-f10fd1320107 req-105271be-5214-4c9b-b265-508200d31306 service nova] Creating event network-vif-plugged:666ba69f-5b53-402b-9db5-8013b146c1da for instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a on hv-cinder-83754 Jul 29 11:48:53.358858 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-47337bd6-113c-44df-aaa5-f10fd1320107 req-105271be-5214-4c9b-b265-508200d31306 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046982 Jul 29 11:48:53.359450 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 164/314] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:48:53.816032 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-7397c2ee-47ae-4aef-a612-94f6cd6500d1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:53.816672 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-7397c2ee-47ae-4aef-a612-94f6cd6500d1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:53.823844 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7397c2ee-47ae-4aef-a612-94f6cd6500d1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:53.824334 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7397c2ee-47ae-4aef-a612-94f6cd6500d1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:53.825118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7397c2ee-47ae-4aef-a612-94f6cd6500d1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:53.825589 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7397c2ee-47ae-4aef-a612-94f6cd6500d1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:53.992258 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-7397c2ee-47ae-4aef-a612-94f6cd6500d1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:54.000784 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-7397c2ee-47ae-4aef-a612-94f6cd6500d1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1371 microversion: 2.1 time: 0.188678 Jul 29 11:48:54.001557 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 151/315] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:53 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:54.157205 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-90027b31-26f3-4c90-b2d0-7c0125ab7cb5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:54.158844 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-90027b31-26f3-4c90-b2d0-7c0125ab7cb5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:54.165496 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-90027b31-26f3-4c90-b2d0-7c0125ab7cb5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:54.165950 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-90027b31-26f3-4c90-b2d0-7c0125ab7cb5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:54.166718 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-90027b31-26f3-4c90-b2d0-7c0125ab7cb5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:54.167157 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-90027b31-26f3-4c90-b2d0-7c0125ab7cb5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:54.303753 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-1ec65b37-46bd-4559-ab0f-3e79fa9bd0f9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:54.304586 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-1ec65b37-46bd-4559-ab0f-3e79fa9bd0f9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:54.305367 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-90027b31-26f3-4c90-b2d0-7c0125ab7cb5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:54.311680 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1ec65b37-46bd-4559-ab0f-3e79fa9bd0f9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:54.312399 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1ec65b37-46bd-4559-ab0f-3e79fa9bd0f9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:54.313184 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1ec65b37-46bd-4559-ab0f-3e79fa9bd0f9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:54.313662 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1ec65b37-46bd-4559-ab0f-3e79fa9bd0f9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:54.315212 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-90027b31-26f3-4c90-b2d0-7c0125ab7cb5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:54.318492 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-90027b31-26f3-4c90-b2d0-7c0125ab7cb5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:54.321330 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-90027b31-26f3-4c90-b2d0-7c0125ab7cb5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1722 microversion: 2.20 time: 0.168913 Jul 29 11:48:54.334111 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 165/316] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:54 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:54.457689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-1ec65b37-46bd-4559-ab0f-3e79fa9bd0f9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:54.466080 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-1ec65b37-46bd-4559-ab0f-3e79fa9bd0f9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.166087 Jul 29 11:48:54.466894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 152/317] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:54 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:55.022909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-916c649b-c229-46b2-b827-da935bd1a6be tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:55.023678 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-916c649b-c229-46b2-b827-da935bd1a6be tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:55.038713 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-916c649b-c229-46b2-b827-da935bd1a6be tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:55.039446 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-916c649b-c229-46b2-b827-da935bd1a6be tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:55.040349 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-916c649b-c229-46b2-b827-da935bd1a6be tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:55.040867 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-916c649b-c229-46b2-b827-da935bd1a6be tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:55.068359 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=2 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:55.148256 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-1e950202-d87d-4609-9054-22ca429e3a5a req-6baea792-3f4e-49f2-9558-305842d1cef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fca404e-1bae-45f1-b4c7-0f1363d90a44", "tag": "4320296e-8fd1-4e24-b644-cad52e9c4572"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:55.158487 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-1e950202-d87d-4609-9054-22ca429e3a5a req-6baea792-3f4e-49f2-9558-305842d1cef0 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:55.158997 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-1e950202-d87d-4609-9054-22ca429e3a5a req-6baea792-3f4e-49f2-9558-305842d1cef0 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:55.171854 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-1e950202-d87d-4609-9054-22ca429e3a5a req-6baea792-3f4e-49f2-9558-305842d1cef0 service nova] Creating event network-changed:4320296e-8fd1-4e24-b644-cad52e9c4572 for instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 on hv-cinder-83754 Jul 29 11:48:55.180020 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-1e950202-d87d-4609-9054-22ca429e3a5a req-6baea792-3f4e-49f2-9558-305842d1cef0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035472 Jul 29 11:48:55.181153 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 153/318] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:48:55.208476 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-916c649b-c229-46b2-b827-da935bd1a6be tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:55.216352 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-916c649b-c229-46b2-b827-da935bd1a6be tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1371 microversion: 2.1 time: 0.197775 Jul 29 11:48:55.216931 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 166/319] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:55 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:55.346676 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6a587e68-4767-4645-b8a6-3754a1495971 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:55.347374 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6a587e68-4767-4645-b8a6-3754a1495971 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:55.353660 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6a587e68-4767-4645-b8a6-3754a1495971 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:55.354373 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6a587e68-4767-4645-b8a6-3754a1495971 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:55.355141 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6a587e68-4767-4645-b8a6-3754a1495971 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:55.356127 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6a587e68-4767-4645-b8a6-3754a1495971 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:55.487216 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-df017764-3f89-476e-9873-a193ae2b5476 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:55.488143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-df017764-3f89-476e-9873-a193ae2b5476 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:55.490018 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:48:55.497008 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-df017764-3f89-476e-9873-a193ae2b5476 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:55.497487 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-df017764-3f89-476e-9873-a193ae2b5476 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:55.498270 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-df017764-3f89-476e-9873-a193ae2b5476 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:55.498705 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-df017764-3f89-476e-9873-a193ae2b5476 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:55.503052 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6a587e68-4767-4645-b8a6-3754a1495971 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:55.511310 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6a587e68-4767-4645-b8a6-3754a1495971 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:55.512957 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6a587e68-4767-4645-b8a6-3754a1495971 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:55.514174 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6a587e68-4767-4645-b8a6-3754a1495971 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1722 microversion: 2.20 time: 0.171720 Jul 29 11:48:55.514733 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 154/320] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:55 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:55.852098 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-df017764-3f89-476e-9873-a193ae2b5476 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:55.860188 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-df017764-3f89-476e-9873-a193ae2b5476 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.376975 Jul 29 11:48:55.860746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 167/321] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:55 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:48:56.237610 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-263aaafe-d118-43e1-a3c2-20219d1d2130 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:56.238328 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-263aaafe-d118-43e1-a3c2-20219d1d2130 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:56.244649 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-263aaafe-d118-43e1-a3c2-20219d1d2130 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:56.245098 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-263aaafe-d118-43e1-a3c2-20219d1d2130 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:56.245882 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-263aaafe-d118-43e1-a3c2-20219d1d2130 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:56.246314 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-263aaafe-d118-43e1-a3c2-20219d1d2130 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:56.390345 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-263aaafe-d118-43e1-a3c2-20219d1d2130 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:56.397848 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-263aaafe-d118-43e1-a3c2-20219d1d2130 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1371 microversion: 2.1 time: 0.163997 Jul 29 11:48:56.398430 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 155/322] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:56 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:56.537613 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-faa69565-7de9-4155-948b-9305efccae3c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:56.538244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-faa69565-7de9-4155-948b-9305efccae3c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:56.544617 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-faa69565-7de9-4155-948b-9305efccae3c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:56.545058 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-faa69565-7de9-4155-948b-9305efccae3c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:56.545836 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-faa69565-7de9-4155-948b-9305efccae3c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:56.546268 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-faa69565-7de9-4155-948b-9305efccae3c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:56.675768 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-faa69565-7de9-4155-948b-9305efccae3c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:56.684571 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-faa69565-7de9-4155-948b-9305efccae3c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:56.686118 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-faa69565-7de9-4155-948b-9305efccae3c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:56.687281 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-faa69565-7de9-4155-948b-9305efccae3c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1722 microversion: 2.20 time: 0.153615 Jul 29 11:48:56.687899 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 168/323] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:56 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:56.881465 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-393e75d3-2271-4c02-86a7-49a5d5d55cfd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:56.882010 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-393e75d3-2271-4c02-86a7-49a5d5d55cfd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:56.888592 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-393e75d3-2271-4c02-86a7-49a5d5d55cfd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:56.889027 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-393e75d3-2271-4c02-86a7-49a5d5d55cfd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:56.889829 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-393e75d3-2271-4c02-86a7-49a5d5d55cfd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:56.890273 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-393e75d3-2271-4c02-86a7-49a5d5d55cfd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:57.016634 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-393e75d3-2271-4c02-86a7-49a5d5d55cfd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:57.024093 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-393e75d3-2271-4c02-86a7-49a5d5d55cfd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.146616 Jul 29 11:48:57.024659 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 156/324] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:56 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:57.417824 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-abada24b-717a-4779-bb2d-e0ad0f17e78e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:57.418462 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-abada24b-717a-4779-bb2d-e0ad0f17e78e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:57.424472 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-abada24b-717a-4779-bb2d-e0ad0f17e78e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:57.424923 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-abada24b-717a-4779-bb2d-e0ad0f17e78e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:57.425711 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-abada24b-717a-4779-bb2d-e0ad0f17e78e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:57.426153 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-abada24b-717a-4779-bb2d-e0ad0f17e78e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:57.554006 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-abada24b-717a-4779-bb2d-e0ad0f17e78e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:57.561437 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-abada24b-717a-4779-bb2d-e0ad0f17e78e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1371 microversion: 2.1 time: 0.147479 Jul 29 11:48:57.562002 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 169/325] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:57 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:57.710200 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-cd844b4b-9c1f-419c-8d6a-84b9514da4e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:57.710820 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-cd844b4b-9c1f-419c-8d6a-84b9514da4e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:57.718104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cd844b4b-9c1f-419c-8d6a-84b9514da4e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:57.718498 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cd844b4b-9c1f-419c-8d6a-84b9514da4e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:57.719277 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cd844b4b-9c1f-419c-8d6a-84b9514da4e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:57.719719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cd844b4b-9c1f-419c-8d6a-84b9514da4e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:57.832919 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-719d2576-62b5-4a4a-96b4-57510d4a84de req-e6c6713f-23a2-4e98-ac30-e65e0f8e2a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7bd0b02-2726-4432-a6a1-53035c9a1978", "name": "network-vif-unplugged", "status": "completed", "tag": "fb1642b2-a468-43c6-8233-7e7bcc25cfcd"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:48:57.844974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-719d2576-62b5-4a4a-96b4-57510d4a84de req-e6c6713f-23a2-4e98-ac30-e65e0f8e2a88 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:57.846674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-719d2576-62b5-4a4a-96b4-57510d4a84de req-e6c6713f-23a2-4e98-ac30-e65e0f8e2a88 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:57.859534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-cd844b4b-9c1f-419c-8d6a-84b9514da4e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:57.864088 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-719d2576-62b5-4a4a-96b4-57510d4a84de req-e6c6713f-23a2-4e98-ac30-e65e0f8e2a88 service nova] Creating event network-vif-unplugged:fb1642b2-a468-43c6-8233-7e7bcc25cfcd for instance d7bd0b02-2726-4432-a6a1-53035c9a1978 on hv-cinder-83754 Jul 29 11:48:57.869045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-cd844b4b-9c1f-419c-8d6a-84b9514da4e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:57.869381 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-719d2576-62b5-4a4a-96b4-57510d4a84de req-e6c6713f-23a2-4e98-ac30-e65e0f8e2a88 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040064 Jul 29 11:48:57.870281 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 170/326] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:48:57.870745 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-cd844b4b-9c1f-419c-8d6a-84b9514da4e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:57.872820 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-cd844b4b-9c1f-419c-8d6a-84b9514da4e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1722 microversion: 2.20 time: 0.166525 Jul 29 11:48:57.873676 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 157/327] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:57 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:58.045880 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-7d61cdd7-7ff8-4755-b8fd-a047e050ac1b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:58.046508 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-7d61cdd7-7ff8-4755-b8fd-a047e050ac1b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:58.052772 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7d61cdd7-7ff8-4755-b8fd-a047e050ac1b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:58.053226 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7d61cdd7-7ff8-4755-b8fd-a047e050ac1b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:58.054023 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7d61cdd7-7ff8-4755-b8fd-a047e050ac1b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:58.054464 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7d61cdd7-7ff8-4755-b8fd-a047e050ac1b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:58.183543 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-7d61cdd7-7ff8-4755-b8fd-a047e050ac1b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:58.191883 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-7d61cdd7-7ff8-4755-b8fd-a047e050ac1b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.150426 Jul 29 11:48:58.192452 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 171/328] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:58 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:58.582424 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-b0e50d52-b88b-4161-b16c-d4e578bfb98b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:58.583039 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-b0e50d52-b88b-4161-b16c-d4e578bfb98b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:58.588988 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b0e50d52-b88b-4161-b16c-d4e578bfb98b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:58.589469 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b0e50d52-b88b-4161-b16c-d4e578bfb98b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:58.591053 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b0e50d52-b88b-4161-b16c-d4e578bfb98b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:58.591494 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b0e50d52-b88b-4161-b16c-d4e578bfb98b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:58.723074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-b0e50d52-b88b-4161-b16c-d4e578bfb98b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:58.731030 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-b0e50d52-b88b-4161-b16c-d4e578bfb98b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1371 microversion: 2.1 time: 0.151801 Jul 29 11:48:58.731678 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 158/329] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:58 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:58.896698 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f4aa7e2b-0508-4dc4-a23d-490ce056a6e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:58.897305 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f4aa7e2b-0508-4dc4-a23d-490ce056a6e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:58.904688 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f4aa7e2b-0508-4dc4-a23d-490ce056a6e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:58.905135 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f4aa7e2b-0508-4dc4-a23d-490ce056a6e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:58.905925 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f4aa7e2b-0508-4dc4-a23d-490ce056a6e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:58.906354 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f4aa7e2b-0508-4dc4-a23d-490ce056a6e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:59.034538 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f4aa7e2b-0508-4dc4-a23d-490ce056a6e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:59.042593 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f4aa7e2b-0508-4dc4-a23d-490ce056a6e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:59.044664 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f4aa7e2b-0508-4dc4-a23d-490ce056a6e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:59.045856 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f4aa7e2b-0508-4dc4-a23d-490ce056a6e6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1722 microversion: 2.20 time: 0.152990 Jul 29 11:48:59.046418 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 172/330] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:48:58 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:48:59.212094 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-d73011f7-1b37-4f64-9a55-e1edd00371a7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:59.212714 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-d73011f7-1b37-4f64-9a55-e1edd00371a7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:59.219309 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d73011f7-1b37-4f64-9a55-e1edd00371a7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:59.219769 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d73011f7-1b37-4f64-9a55-e1edd00371a7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:59.220537 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d73011f7-1b37-4f64-9a55-e1edd00371a7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:59.220974 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d73011f7-1b37-4f64-9a55-e1edd00371a7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:59.352164 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-d73011f7-1b37-4f64-9a55-e1edd00371a7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:59.359841 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-d73011f7-1b37-4f64-9a55-e1edd00371a7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.151584 Jul 29 11:48:59.360409 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 159/331] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:59 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:48:59.751759 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1a12de6a-b618-4892-88a0-85edab3b4aa6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:48:59.752442 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-1a12de6a-b618-4892-88a0-85edab3b4aa6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:48:59.758521 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1a12de6a-b618-4892-88a0-85edab3b4aa6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:59.758975 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1a12de6a-b618-4892-88a0-85edab3b4aa6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:59.759742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1a12de6a-b618-4892-88a0-85edab3b4aa6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:48:59.760180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1a12de6a-b618-4892-88a0-85edab3b4aa6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:48:59.918849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1a12de6a-b618-4892-88a0-85edab3b4aa6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:48:59.926418 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1a12de6a-b618-4892-88a0-85edab3b4aa6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1371 microversion: 2.1 time: 0.178520 Jul 29 11:48:59.927039 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 173/332] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:48:59 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:00.068204 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-21002524-6c05-4394-8655-8eca10bfdaaa tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:00.068736 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-21002524-6c05-4394-8655-8eca10bfdaaa tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:00.075393 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-21002524-6c05-4394-8655-8eca10bfdaaa tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:00.075843 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-21002524-6c05-4394-8655-8eca10bfdaaa tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:00.076608 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-21002524-6c05-4394-8655-8eca10bfdaaa tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:00.077035 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-21002524-6c05-4394-8655-8eca10bfdaaa tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:00.204836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-21002524-6c05-4394-8655-8eca10bfdaaa tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:00.207147 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=100 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:00.214260 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-21002524-6c05-4394-8655-8eca10bfdaaa tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:00.216367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-21002524-6c05-4394-8655-8eca10bfdaaa tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:00.217555 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-21002524-6c05-4394-8655-8eca10bfdaaa tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1722 microversion: 2.20 time: 0.153365 Jul 29 11:49:00.218107 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 160/333] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:00 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:00.381922 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-08a8de4a-689a-4f73-ab88-14224e8f1ae6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:00.382448 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-08a8de4a-689a-4f73-ab88-14224e8f1ae6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:00.390325 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-08a8de4a-689a-4f73-ab88-14224e8f1ae6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:00.390833 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-08a8de4a-689a-4f73-ab88-14224e8f1ae6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:00.391615 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-08a8de4a-689a-4f73-ab88-14224e8f1ae6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:00.392057 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-08a8de4a-689a-4f73-ab88-14224e8f1ae6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:00.550141 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-08a8de4a-689a-4f73-ab88-14224e8f1ae6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:00.557779 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-08a8de4a-689a-4f73-ab88-14224e8f1ae6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.179825 Jul 29 11:49:00.558382 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 174/334] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:00 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:00.947823 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-b19d3906-1335-4625-b94e-7371284bd9d2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:00.948474 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-b19d3906-1335-4625-b94e-7371284bd9d2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:00.951222 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:00.956638 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b19d3906-1335-4625-b94e-7371284bd9d2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:00.957086 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b19d3906-1335-4625-b94e-7371284bd9d2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:00.957872 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b19d3906-1335-4625-b94e-7371284bd9d2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:00.958311 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b19d3906-1335-4625-b94e-7371284bd9d2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:01.086871 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-b19d3906-1335-4625-b94e-7371284bd9d2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:01.094603 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-b19d3906-1335-4625-b94e-7371284bd9d2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1564 microversion: 2.1 time: 0.150621 Jul 29 11:49:01.095161 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 161/335] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:00 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:01.115551 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-424c2eef-49f5-405c-b69f-f41dba50f84b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:01.116188 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-424c2eef-49f5-405c-b69f-f41dba50f84b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:01.123075 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-424c2eef-49f5-405c-b69f-f41dba50f84b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:01.123518 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-424c2eef-49f5-405c-b69f-f41dba50f84b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:01.124295 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-424c2eef-49f5-405c-b69f-f41dba50f84b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:01.124726 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-424c2eef-49f5-405c-b69f-f41dba50f84b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:01.202545 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-424c2eef-49f5-405c-b69f-f41dba50f84b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090765 Jul 29 11:49:01.203135 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 175/336] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Jul 29 11:49:01 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:49:01.240206 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ffbd94b3-1460-4cf3-b97c-aa7e323d2ca4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:01.240824 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ffbd94b3-1460-4cf3-b97c-aa7e323d2ca4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:01.247766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ffbd94b3-1460-4cf3-b97c-aa7e323d2ca4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:01.248223 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ffbd94b3-1460-4cf3-b97c-aa7e323d2ca4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:01.249055 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ffbd94b3-1460-4cf3-b97c-aa7e323d2ca4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:01.249516 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ffbd94b3-1460-4cf3-b97c-aa7e323d2ca4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:01.492319 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ffbd94b3-1460-4cf3-b97c-aa7e323d2ca4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:01.501856 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ffbd94b3-1460-4cf3-b97c-aa7e323d2ca4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:01.503371 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ffbd94b3-1460-4cf3-b97c-aa7e323d2ca4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:01.504529 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ffbd94b3-1460-4cf3-b97c-aa7e323d2ca4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1665 microversion: 2.20 time: 0.268333 Jul 29 11:49:01.505088 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 162/337] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:01 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1665 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:01.528000 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-30e7653c-3514-4e8c-8a47-e3f40f1be74d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c258df52-a481-461c-960e-3ae925eca729"}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:49:01.530487 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-30e7653c-3514-4e8c-8a47-e3f40f1be74d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:01.536454 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-30e7653c-3514-4e8c-8a47-e3f40f1be74d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:01.536996 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-30e7653c-3514-4e8c-8a47-e3f40f1be74d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:01.537862 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-30e7653c-3514-4e8c-8a47-e3f40f1be74d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:01.538361 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-30e7653c-3514-4e8c-8a47-e3f40f1be74d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:01.580241 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-612bfc11-e7ef-4cc6-a6f1-40c21f1e71ea tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:01.580860 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-612bfc11-e7ef-4cc6-a6f1-40c21f1e71ea tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:01.586867 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-612bfc11-e7ef-4cc6-a6f1-40c21f1e71ea tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:01.587324 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-612bfc11-e7ef-4cc6-a6f1-40c21f1e71ea tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:01.588097 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-612bfc11-e7ef-4cc6-a6f1-40c21f1e71ea tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:01.588534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-612bfc11-e7ef-4cc6-a6f1-40c21f1e71ea tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:01.798364 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-612bfc11-e7ef-4cc6-a6f1-40c21f1e71ea tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:01.805815 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-612bfc11-e7ef-4cc6-a6f1-40c21f1e71ea tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.230809 Jul 29 11:49:01.806563 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 163/338] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:01 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:49:01.826718 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-30e7653c-3514-4e8c-8a47-e3f40f1be74d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "POST /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.303164 Jul 29 11:49:01.833012 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 176/339] 10.222.0.60 () {62 vars in 1364 bytes} [Fri Jul 29 11:49:01 2022] POST /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/os-volume_attachments => generated 188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 11:49:01.950817 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-67927547-f34e-4dd1-af62-3bcb4fa3c842 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:49:01.951473 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-67927547-f34e-4dd1-af62-3bcb4fa3c842 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:01.957731 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-67927547-f34e-4dd1-af62-3bcb4fa3c842 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:01.958185 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-67927547-f34e-4dd1-af62-3bcb4fa3c842 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:01.958949 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-67927547-f34e-4dd1-af62-3bcb4fa3c842 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:01.959380 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-67927547-f34e-4dd1-af62-3bcb4fa3c842 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:02.008920 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-67927547-f34e-4dd1-af62-3bcb4fa3c842 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129585) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 11:49:02.019492 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:02.043928 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=10 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:02.078920 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-67927547-f34e-4dd1-af62-3bcb4fa3c842 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "POST /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/action" status: 202 len: 0 microversion: 2.20 time: 0.132499 Jul 29 11:49:02.080319 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 164/340] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Jul 29 11:49:01 2022] POST /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:49:02.088146 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-193947b2-3781-4774-abd8-bae716321708 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:02.088760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-193947b2-3781-4774-abd8-bae716321708 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:02.095697 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-193947b2-3781-4774-abd8-bae716321708 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:02.096158 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-193947b2-3781-4774-abd8-bae716321708 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:02.096935 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-193947b2-3781-4774-abd8-bae716321708 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:02.097375 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-193947b2-3781-4774-abd8-bae716321708 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:02.177586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=14 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:02.293406 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-193947b2-3781-4774-abd8-bae716321708 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:02.301964 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-193947b2-3781-4774-abd8-bae716321708 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:02.303589 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-193947b2-3781-4774-abd8-bae716321708 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:02.304802 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-193947b2-3781-4774-abd8-bae716321708 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1751 microversion: 2.20 time: 0.220531 Jul 29 11:49:02.305894 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 177/341] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:02 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1751 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:02.404825 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-e0b42644-030c-433c-9304-3cc3a276d3d9 req-dc93db35-e631-4825-966e-8cb410447e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b4f838-c329-43d2-8448-82ad1ee8ad2a", "tag": "666ba69f-5b53-402b-9db5-8013b146c1da"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:49:02.415764 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-e0b42644-030c-433c-9304-3cc3a276d3d9 req-dc93db35-e631-4825-966e-8cb410447e26 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:02.416227 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-e0b42644-030c-433c-9304-3cc3a276d3d9 req-dc93db35-e631-4825-966e-8cb410447e26 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:02.429543 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-e0b42644-030c-433c-9304-3cc3a276d3d9 req-dc93db35-e631-4825-966e-8cb410447e26 service nova] Creating event network-changed:666ba69f-5b53-402b-9db5-8013b146c1da for instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a on hv-cinder-83754 Jul 29 11:49:02.436170 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-e0b42644-030c-433c-9304-3cc3a276d3d9 req-dc93db35-e631-4825-966e-8cb410447e26 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036287 Jul 29 11:49:02.436934 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 165/342] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:49:02.831887 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-0c40fdc6-1c97-4957-913e-ffcf95d05a52 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:02.832608 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-0c40fdc6-1c97-4957-913e-ffcf95d05a52 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:02.840545 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0c40fdc6-1c97-4957-913e-ffcf95d05a52 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:02.841357 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0c40fdc6-1c97-4957-913e-ffcf95d05a52 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:02.843299 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0c40fdc6-1c97-4957-913e-ffcf95d05a52 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:02.843750 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0c40fdc6-1c97-4957-913e-ffcf95d05a52 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:02.995130 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-0c40fdc6-1c97-4957-913e-ffcf95d05a52 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:03.003841 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-0c40fdc6-1c97-4957-913e-ffcf95d05a52 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.179374 Jul 29 11:49:03.004581 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 178/343] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:02 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:49:03.328946 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a364abcb-bbba-474a-aaa0-60097c98f948 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:03.329683 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a364abcb-bbba-474a-aaa0-60097c98f948 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:03.336683 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a364abcb-bbba-474a-aaa0-60097c98f948 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:03.337213 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a364abcb-bbba-474a-aaa0-60097c98f948 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:03.337936 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a364abcb-bbba-474a-aaa0-60097c98f948 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:03.338377 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a364abcb-bbba-474a-aaa0-60097c98f948 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:03.473808 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a364abcb-bbba-474a-aaa0-60097c98f948 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:03.483403 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a364abcb-bbba-474a-aaa0-60097c98f948 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:03.486059 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a364abcb-bbba-474a-aaa0-60097c98f948 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:03.487221 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a364abcb-bbba-474a-aaa0-60097c98f948 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1751 microversion: 2.20 time: 0.163333 Jul 29 11:49:03.487777 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 166/344] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:03 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:04.025209 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1d55182f-127c-42a6-93dd-86dcf2ef20fd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:04.025840 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-1d55182f-127c-42a6-93dd-86dcf2ef20fd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:04.032883 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1d55182f-127c-42a6-93dd-86dcf2ef20fd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:04.033338 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1d55182f-127c-42a6-93dd-86dcf2ef20fd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:04.034136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1d55182f-127c-42a6-93dd-86dcf2ef20fd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:04.034609 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1d55182f-127c-42a6-93dd-86dcf2ef20fd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:04.051063 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:04.169572 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1d55182f-127c-42a6-93dd-86dcf2ef20fd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:04.177108 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1d55182f-127c-42a6-93dd-86dcf2ef20fd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.156415 Jul 29 11:49:04.177717 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 179/345] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:04 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:04.512358 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8a1430b5-4b0d-4159-a52a-35d062c425b6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:04.513004 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8a1430b5-4b0d-4159-a52a-35d062c425b6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:04.519539 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8a1430b5-4b0d-4159-a52a-35d062c425b6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:04.519997 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8a1430b5-4b0d-4159-a52a-35d062c425b6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:04.520764 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8a1430b5-4b0d-4159-a52a-35d062c425b6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:04.521210 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8a1430b5-4b0d-4159-a52a-35d062c425b6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:04.649011 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-8a1430b5-4b0d-4159-a52a-35d062c425b6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:04.657620 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-8a1430b5-4b0d-4159-a52a-35d062c425b6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:04.659107 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-8a1430b5-4b0d-4159-a52a-35d062c425b6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:04.660258 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8a1430b5-4b0d-4159-a52a-35d062c425b6 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1753 microversion: 2.20 time: 0.153029 Jul 29 11:49:04.660830 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 167/346] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:04 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:05.197394 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-10c76d04-3461-4307-9d76-cac6c920c5be tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:05.198036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-10c76d04-3461-4307-9d76-cac6c920c5be tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:05.204741 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-10c76d04-3461-4307-9d76-cac6c920c5be tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:05.205191 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-10c76d04-3461-4307-9d76-cac6c920c5be tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:05.205989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-10c76d04-3461-4307-9d76-cac6c920c5be tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:05.206420 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-10c76d04-3461-4307-9d76-cac6c920c5be tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:05.344799 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-10c76d04-3461-4307-9d76-cac6c920c5be tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:05.352171 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-10c76d04-3461-4307-9d76-cac6c920c5be tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.158571 Jul 29 11:49:05.352734 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 180/347] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:05 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:05.683054 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-48a2253c-acdd-4e35-a641-c30da981602e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:05.683818 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-48a2253c-acdd-4e35-a641-c30da981602e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:05.690278 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-48a2253c-acdd-4e35-a641-c30da981602e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:05.690724 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-48a2253c-acdd-4e35-a641-c30da981602e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:05.691478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-48a2253c-acdd-4e35-a641-c30da981602e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:05.691907 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-48a2253c-acdd-4e35-a641-c30da981602e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:05.818106 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-48a2253c-acdd-4e35-a641-c30da981602e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:05.827240 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-48a2253c-acdd-4e35-a641-c30da981602e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:05.828740 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-48a2253c-acdd-4e35-a641-c30da981602e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:05.829951 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-48a2253c-acdd-4e35-a641-c30da981602e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1753 microversion: 2.20 time: 0.150844 Jul 29 11:49:05.830506 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 168/348] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:05 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:06.374336 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f0859c1f-fa13-4a23-9e12-4080f96895de tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:06.374944 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f0859c1f-fa13-4a23-9e12-4080f96895de tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:06.381255 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f0859c1f-fa13-4a23-9e12-4080f96895de tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:06.381728 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f0859c1f-fa13-4a23-9e12-4080f96895de tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:06.382513 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f0859c1f-fa13-4a23-9e12-4080f96895de tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:06.382944 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f0859c1f-fa13-4a23-9e12-4080f96895de tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:06.516324 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f0859c1f-fa13-4a23-9e12-4080f96895de tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:06.523845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f0859c1f-fa13-4a23-9e12-4080f96895de tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.154376 Jul 29 11:49:06.524422 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 181/349] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:06 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:06.853603 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a6a24146-f6cd-4c9d-8879-0f41501a2ff3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:06.854154 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a6a24146-f6cd-4c9d-8879-0f41501a2ff3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:06.861178 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a6a24146-f6cd-4c9d-8879-0f41501a2ff3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:06.861663 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a6a24146-f6cd-4c9d-8879-0f41501a2ff3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:06.862429 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a6a24146-f6cd-4c9d-8879-0f41501a2ff3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:06.862865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a6a24146-f6cd-4c9d-8879-0f41501a2ff3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:06.989727 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a6a24146-f6cd-4c9d-8879-0f41501a2ff3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:06.998702 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a6a24146-f6cd-4c9d-8879-0f41501a2ff3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:07.000220 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a6a24146-f6cd-4c9d-8879-0f41501a2ff3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:07.001386 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a6a24146-f6cd-4c9d-8879-0f41501a2ff3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1753 microversion: 2.20 time: 0.151829 Jul 29 11:49:07.001973 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 169/350] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:06 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:07.544800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-11c64f6f-77db-40a9-8c50-c877064ac45d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:07.545407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-11c64f6f-77db-40a9-8c50-c877064ac45d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:07.551878 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-11c64f6f-77db-40a9-8c50-c877064ac45d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:07.552327 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-11c64f6f-77db-40a9-8c50-c877064ac45d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:07.553080 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-11c64f6f-77db-40a9-8c50-c877064ac45d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:07.553539 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-11c64f6f-77db-40a9-8c50-c877064ac45d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:07.679058 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-11c64f6f-77db-40a9-8c50-c877064ac45d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:07.686576 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-11c64f6f-77db-40a9-8c50-c877064ac45d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.146213 Jul 29 11:49:07.687142 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 182/351] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:07 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:08.025885 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-82a1ba7f-8a66-4833-b43a-4b267ecf2e00 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:08.026800 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-82a1ba7f-8a66-4833-b43a-4b267ecf2e00 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:08.033929 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-82a1ba7f-8a66-4833-b43a-4b267ecf2e00 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:08.034379 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-82a1ba7f-8a66-4833-b43a-4b267ecf2e00 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:08.035135 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-82a1ba7f-8a66-4833-b43a-4b267ecf2e00 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:08.035568 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-82a1ba7f-8a66-4833-b43a-4b267ecf2e00 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:08.167990 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-82a1ba7f-8a66-4833-b43a-4b267ecf2e00 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:08.176392 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-82a1ba7f-8a66-4833-b43a-4b267ecf2e00 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:08.177930 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-82a1ba7f-8a66-4833-b43a-4b267ecf2e00 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:08.179107 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-82a1ba7f-8a66-4833-b43a-4b267ecf2e00 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1753 microversion: 2.20 time: 0.157485 Jul 29 11:49:08.179694 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 170/352] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:08 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:08.707341 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-20685314-de5f-4ad6-9ddd-1555b8f71168 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:08.708624 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-20685314-de5f-4ad6-9ddd-1555b8f71168 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:08.715716 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-20685314-de5f-4ad6-9ddd-1555b8f71168 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:08.716300 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-20685314-de5f-4ad6-9ddd-1555b8f71168 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:08.717124 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-20685314-de5f-4ad6-9ddd-1555b8f71168 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:08.717625 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-20685314-de5f-4ad6-9ddd-1555b8f71168 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:08.851686 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-20685314-de5f-4ad6-9ddd-1555b8f71168 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:08.860247 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-20685314-de5f-4ad6-9ddd-1555b8f71168 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.157050 Jul 29 11:49:08.860812 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 183/353] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:08 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:09.201871 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e16fdec7-8121-4479-9a97-8d2b1b95802d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:09.202479 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e16fdec7-8121-4479-9a97-8d2b1b95802d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:09.208888 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e16fdec7-8121-4479-9a97-8d2b1b95802d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:09.209334 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e16fdec7-8121-4479-9a97-8d2b1b95802d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:09.210118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e16fdec7-8121-4479-9a97-8d2b1b95802d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:09.210551 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e16fdec7-8121-4479-9a97-8d2b1b95802d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:09.341936 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e16fdec7-8121-4479-9a97-8d2b1b95802d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:09.351166 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e16fdec7-8121-4479-9a97-8d2b1b95802d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:09.352671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e16fdec7-8121-4479-9a97-8d2b1b95802d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:09.353909 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e16fdec7-8121-4479-9a97-8d2b1b95802d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.156060 Jul 29 11:49:09.354463 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 171/354] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:09 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:49:09.882019 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4dc476d9-5f17-4895-a6dd-cd7186a9f244 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:09.882631 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-4dc476d9-5f17-4895-a6dd-cd7186a9f244 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:09.890462 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4dc476d9-5f17-4895-a6dd-cd7186a9f244 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:09.890909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4dc476d9-5f17-4895-a6dd-cd7186a9f244 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:09.891667 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4dc476d9-5f17-4895-a6dd-cd7186a9f244 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:09.892102 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4dc476d9-5f17-4895-a6dd-cd7186a9f244 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:10.262891 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-f239f6f7-6b39-48d4-92f6-a63e39ea719e req-cebdf234-ba6f-4ea1-ad8e-211e073a4298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fca404e-1bae-45f1-b4c7-0f1363d90a44", "name": "network-vif-plugged", "status": "completed", "tag": "4320296e-8fd1-4e24-b644-cad52e9c4572"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:49:10.273537 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-f239f6f7-6b39-48d4-92f6-a63e39ea719e req-cebdf234-ba6f-4ea1-ad8e-211e073a4298 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:10.274212 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-f239f6f7-6b39-48d4-92f6-a63e39ea719e req-cebdf234-ba6f-4ea1-ad8e-211e073a4298 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:10.289199 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-f239f6f7-6b39-48d4-92f6-a63e39ea719e req-cebdf234-ba6f-4ea1-ad8e-211e073a4298 service nova] Creating event network-vif-plugged:4320296e-8fd1-4e24-b644-cad52e9c4572 for instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 on hv-cinder-83754 Jul 29 11:49:10.300072 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4dc476d9-5f17-4895-a6dd-cd7186a9f244 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:10.307944 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-4dc476d9-5f17-4895-a6dd-cd7186a9f244 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.429765 Jul 29 11:49:10.311475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-f239f6f7-6b39-48d4-92f6-a63e39ea719e req-cebdf234-ba6f-4ea1-ad8e-211e073a4298 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051910 Jul 29 11:49:10.311961 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 184/355] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:09 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:10.313112 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 172/356] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:49:10.377692 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9b681338-b60b-4ba6-ae2e-c9479d008bad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:10.379132 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-9b681338-b60b-4ba6-ae2e-c9479d008bad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:10.385276 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9b681338-b60b-4ba6-ae2e-c9479d008bad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:10.385703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9b681338-b60b-4ba6-ae2e-c9479d008bad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:10.387481 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9b681338-b60b-4ba6-ae2e-c9479d008bad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:10.387911 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9b681338-b60b-4ba6-ae2e-c9479d008bad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:10.549744 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-9b681338-b60b-4ba6-ae2e-c9479d008bad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:10.560128 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-9b681338-b60b-4ba6-ae2e-c9479d008bad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:10.561660 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-9b681338-b60b-4ba6-ae2e-c9479d008bad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:10.562832 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-9b681338-b60b-4ba6-ae2e-c9479d008bad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.189126 Jul 29 11:49:10.563401 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 185/357] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:10 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:11.332106 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-644618e2-90b2-4fb7-a144-419c852c4edf tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:11.333396 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-644618e2-90b2-4fb7-a144-419c852c4edf tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:11.342295 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-644618e2-90b2-4fb7-a144-419c852c4edf tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:11.342824 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-644618e2-90b2-4fb7-a144-419c852c4edf tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:11.343522 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-644618e2-90b2-4fb7-a144-419c852c4edf tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:11.343963 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-644618e2-90b2-4fb7-a144-419c852c4edf tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:11.490155 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-644618e2-90b2-4fb7-a144-419c852c4edf tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:11.508650 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-644618e2-90b2-4fb7-a144-419c852c4edf tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.181180 Jul 29 11:49:11.509942 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 173/358] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:11 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:11.586318 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6daa7436-5a74-4916-af3f-ca1e80f2f9fb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:11.586995 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6daa7436-5a74-4916-af3f-ca1e80f2f9fb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:11.595753 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6daa7436-5a74-4916-af3f-ca1e80f2f9fb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:11.596166 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6daa7436-5a74-4916-af3f-ca1e80f2f9fb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:11.596954 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6daa7436-5a74-4916-af3f-ca1e80f2f9fb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:11.597466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6daa7436-5a74-4916-af3f-ca1e80f2f9fb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:11.741017 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6daa7436-5a74-4916-af3f-ca1e80f2f9fb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:11.750046 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6daa7436-5a74-4916-af3f-ca1e80f2f9fb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:11.751551 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6daa7436-5a74-4916-af3f-ca1e80f2f9fb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:11.752734 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-6daa7436-5a74-4916-af3f-ca1e80f2f9fb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.171349 Jul 29 11:49:11.753501 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 186/359] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:11 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:49:12.473944 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9f01cc42-d524-4bf2-b055-98069cdc8e96 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:12.474451 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9f01cc42-d524-4bf2-b055-98069cdc8e96 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:12.481916 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9f01cc42-d524-4bf2-b055-98069cdc8e96 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:12.482439 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9f01cc42-d524-4bf2-b055-98069cdc8e96 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:12.483297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9f01cc42-d524-4bf2-b055-98069cdc8e96 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:12.483737 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9f01cc42-d524-4bf2-b055-98069cdc8e96 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:12.530688 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-418cbe84-e3c9-4793-9ca6-4282674ef1e7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:12.531847 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-418cbe84-e3c9-4793-9ca6-4282674ef1e7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:12.545531 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-418cbe84-e3c9-4793-9ca6-4282674ef1e7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:12.545991 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-418cbe84-e3c9-4793-9ca6-4282674ef1e7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:12.546769 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-418cbe84-e3c9-4793-9ca6-4282674ef1e7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:12.547200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-418cbe84-e3c9-4793-9ca6-4282674ef1e7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:12.617209 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.objects.instance [None req-9f01cc42-d524-4bf2-b055-98069cdc8e96 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lazy-loading 'services' on Instance uuid 7529e35b-c6b2-4c8f-896c-fd2060f91657 {{(pid=129585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:49:12.703686 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-418cbe84-e3c9-4793-9ca6-4282674ef1e7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:12.717783 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-418cbe84-e3c9-4793-9ca6-4282674ef1e7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.190739 Jul 29 11:49:12.718398 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 187/360] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:12 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:12.756964 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9f01cc42-d524-4bf2-b055-98069cdc8e96 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657/os-volume_attachments/f565fa53-400e-43c9-9b0f-cd291ba242b1" status: 202 len: 0 microversion: 2.1 time: 0.286791 Jul 29 11:49:12.757588 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 174/361] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Jul 29 11:49:12 2022] DELETE /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657/os-volume_attachments/f565fa53-400e-43c9-9b0f-cd291ba242b1 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:49:12.776278 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-91461abb-f684-44dc-b484-705d3b6a21d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:12.777685 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-91461abb-f684-44dc-b484-705d3b6a21d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:12.784014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-91461abb-f684-44dc-b484-705d3b6a21d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:12.784460 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-91461abb-f684-44dc-b484-705d3b6a21d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:12.785259 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-91461abb-f684-44dc-b484-705d3b6a21d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:12.785708 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-91461abb-f684-44dc-b484-705d3b6a21d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:12.925182 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-91461abb-f684-44dc-b484-705d3b6a21d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:12.933832 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-91461abb-f684-44dc-b484-705d3b6a21d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:12.935329 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-91461abb-f684-44dc-b484-705d3b6a21d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:12.936485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-91461abb-f684-44dc-b484-705d3b6a21d9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.164363 Jul 29 11:49:12.937039 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 188/362] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:12 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:13.739749 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a05b5e81-3b20-41c0-892f-3d8753498ae7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:13.740442 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a05b5e81-3b20-41c0-892f-3d8753498ae7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:13.747403 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a05b5e81-3b20-41c0-892f-3d8753498ae7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:13.747853 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a05b5e81-3b20-41c0-892f-3d8753498ae7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:13.748667 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a05b5e81-3b20-41c0-892f-3d8753498ae7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:13.749053 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a05b5e81-3b20-41c0-892f-3d8753498ae7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:13.892151 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a05b5e81-3b20-41c0-892f-3d8753498ae7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:13.904845 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a05b5e81-3b20-41c0-892f-3d8753498ae7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.169178 Jul 29 11:49:13.906130 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 175/363] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:13 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:13.960253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1cea48e1-4b8b-4521-8d4f-405077d1e9d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:13.960867 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-1cea48e1-4b8b-4521-8d4f-405077d1e9d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:13.968317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1cea48e1-4b8b-4521-8d4f-405077d1e9d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:13.968775 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1cea48e1-4b8b-4521-8d4f-405077d1e9d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:13.969760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1cea48e1-4b8b-4521-8d4f-405077d1e9d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:13.970318 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1cea48e1-4b8b-4521-8d4f-405077d1e9d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:14.144650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1cea48e1-4b8b-4521-8d4f-405077d1e9d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:14.154208 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1cea48e1-4b8b-4521-8d4f-405077d1e9d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:14.155688 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1cea48e1-4b8b-4521-8d4f-405077d1e9d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:14.156854 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1cea48e1-4b8b-4521-8d4f-405077d1e9d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.200646 Jul 29 11:49:14.157622 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 189/364] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:13 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:49:14.927542 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-7391b15c-bc8e-41b0-861e-14339d8fb676 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:14.928941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-7391b15c-bc8e-41b0-861e-14339d8fb676 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:14.939594 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7391b15c-bc8e-41b0-861e-14339d8fb676 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:14.940297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7391b15c-bc8e-41b0-861e-14339d8fb676 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:14.941315 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7391b15c-bc8e-41b0-861e-14339d8fb676 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:14.942248 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7391b15c-bc8e-41b0-861e-14339d8fb676 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:15.083824 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-7391b15c-bc8e-41b0-861e-14339d8fb676 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:15.092617 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-7391b15c-bc8e-41b0-861e-14339d8fb676 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.170455 Jul 29 11:49:15.093199 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 176/365] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:14 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:15.180053 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-2482ddc4-6a19-476c-8869-e3940e62b78b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:15.180697 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-2482ddc4-6a19-476c-8869-e3940e62b78b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:15.187500 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2482ddc4-6a19-476c-8869-e3940e62b78b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:15.187951 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2482ddc4-6a19-476c-8869-e3940e62b78b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:15.188717 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2482ddc4-6a19-476c-8869-e3940e62b78b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:15.189151 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2482ddc4-6a19-476c-8869-e3940e62b78b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:15.334116 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2482ddc4-6a19-476c-8869-e3940e62b78b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:15.344923 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2482ddc4-6a19-476c-8869-e3940e62b78b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:15.346564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2482ddc4-6a19-476c-8869-e3940e62b78b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:15.347744 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-2482ddc4-6a19-476c-8869-e3940e62b78b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.171561 Jul 29 11:49:15.348563 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 190/366] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:15 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:16.114750 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-1581052a-cd3e-4184-90c1-5b3734d684b5 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:16.115490 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-1581052a-cd3e-4184-90c1-5b3734d684b5 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:16.122726 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1581052a-cd3e-4184-90c1-5b3734d684b5 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:16.123170 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1581052a-cd3e-4184-90c1-5b3734d684b5 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:16.123965 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1581052a-cd3e-4184-90c1-5b3734d684b5 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:16.124410 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1581052a-cd3e-4184-90c1-5b3734d684b5 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:16.128493 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:16.267280 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-1581052a-cd3e-4184-90c1-5b3734d684b5 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:16.274635 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-1581052a-cd3e-4184-90c1-5b3734d684b5 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.164020 Jul 29 11:49:16.275193 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 177/367] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:16 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:16.371279 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-86a028cd-8686-40f8-b970-b90aee8a1ddc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:16.371996 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-86a028cd-8686-40f8-b970-b90aee8a1ddc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:16.378760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-86a028cd-8686-40f8-b970-b90aee8a1ddc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:16.379207 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-86a028cd-8686-40f8-b970-b90aee8a1ddc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:16.379975 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-86a028cd-8686-40f8-b970-b90aee8a1ddc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:16.380408 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-86a028cd-8686-40f8-b970-b90aee8a1ddc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:16.519660 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-86a028cd-8686-40f8-b970-b90aee8a1ddc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:16.529094 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-86a028cd-8686-40f8-b970-b90aee8a1ddc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:16.530584 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-86a028cd-8686-40f8-b970-b90aee8a1ddc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:16.531768 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-86a028cd-8686-40f8-b970-b90aee8a1ddc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.164548 Jul 29 11:49:16.544052 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 191/368] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:16 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:17.295882 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c1e83253-33fc-4369-88cf-e9ad9492e808 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:17.296474 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-c1e83253-33fc-4369-88cf-e9ad9492e808 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:17.303349 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c1e83253-33fc-4369-88cf-e9ad9492e808 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:17.303803 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c1e83253-33fc-4369-88cf-e9ad9492e808 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:17.304736 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c1e83253-33fc-4369-88cf-e9ad9492e808 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:17.305176 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c1e83253-33fc-4369-88cf-e9ad9492e808 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:17.451600 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-c1e83253-33fc-4369-88cf-e9ad9492e808 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:17.459370 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-c1e83253-33fc-4369-88cf-e9ad9492e808 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.167677 Jul 29 11:49:17.459963 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 178/369] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:17 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:17.554509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-a146d2fc-e073-423c-84a6-0e5efa9e6f30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:17.555066 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-a146d2fc-e073-423c-84a6-0e5efa9e6f30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:17.562132 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a146d2fc-e073-423c-84a6-0e5efa9e6f30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:17.562580 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a146d2fc-e073-423c-84a6-0e5efa9e6f30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:17.563333 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a146d2fc-e073-423c-84a6-0e5efa9e6f30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:17.563764 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a146d2fc-e073-423c-84a6-0e5efa9e6f30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:17.702105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a146d2fc-e073-423c-84a6-0e5efa9e6f30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:17.710784 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a146d2fc-e073-423c-84a6-0e5efa9e6f30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:17.712277 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a146d2fc-e073-423c-84a6-0e5efa9e6f30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:17.713483 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-a146d2fc-e073-423c-84a6-0e5efa9e6f30 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.162903 Jul 29 11:49:17.714919 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 192/370] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:17 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:18.482027 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-39770ec6-39ff-4c54-9e80-6d787a5164b6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:18.482734 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-39770ec6-39ff-4c54-9e80-6d787a5164b6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:18.490063 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-39770ec6-39ff-4c54-9e80-6d787a5164b6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:18.490534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-39770ec6-39ff-4c54-9e80-6d787a5164b6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:18.491301 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-39770ec6-39ff-4c54-9e80-6d787a5164b6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:18.491735 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-39770ec6-39ff-4c54-9e80-6d787a5164b6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:18.628818 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-39770ec6-39ff-4c54-9e80-6d787a5164b6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:18.637269 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-39770ec6-39ff-4c54-9e80-6d787a5164b6 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.160737 Jul 29 11:49:18.638090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 179/371] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:18 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:18.737296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-890199b4-b9b6-4d7a-aca8-621b21a22750 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:18.737943 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-890199b4-b9b6-4d7a-aca8-621b21a22750 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:18.745549 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-890199b4-b9b6-4d7a-aca8-621b21a22750 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:18.746018 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-890199b4-b9b6-4d7a-aca8-621b21a22750 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:18.747106 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-890199b4-b9b6-4d7a-aca8-621b21a22750 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:18.747555 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-890199b4-b9b6-4d7a-aca8-621b21a22750 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:18.896721 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-890199b4-b9b6-4d7a-aca8-621b21a22750 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:18.906757 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-890199b4-b9b6-4d7a-aca8-621b21a22750 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:18.908239 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-890199b4-b9b6-4d7a-aca8-621b21a22750 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:18.909381 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-890199b4-b9b6-4d7a-aca8-621b21a22750 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.176285 Jul 29 11:49:18.909953 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 193/372] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:18 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:19.659137 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-43d50ea3-d8ba-4aa0-bd8b-f7596b2952fc tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:19.659784 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-43d50ea3-d8ba-4aa0-bd8b-f7596b2952fc tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:19.669065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-43d50ea3-d8ba-4aa0-bd8b-f7596b2952fc tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:19.669613 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-43d50ea3-d8ba-4aa0-bd8b-f7596b2952fc tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:19.670500 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-43d50ea3-d8ba-4aa0-bd8b-f7596b2952fc tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:19.670939 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-43d50ea3-d8ba-4aa0-bd8b-f7596b2952fc tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:19.816916 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-43d50ea3-d8ba-4aa0-bd8b-f7596b2952fc tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:19.825192 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-43d50ea3-d8ba-4aa0-bd8b-f7596b2952fc tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.170338 Jul 29 11:49:19.825804 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 180/373] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:19 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:19.934933 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e973dca4-5ce8-40b4-8811-248780acf7c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:19.936213 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e973dca4-5ce8-40b4-8811-248780acf7c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:19.943024 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e973dca4-5ce8-40b4-8811-248780acf7c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:19.943837 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e973dca4-5ce8-40b4-8811-248780acf7c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:19.944958 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e973dca4-5ce8-40b4-8811-248780acf7c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:19.945647 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e973dca4-5ce8-40b4-8811-248780acf7c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:20.083783 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e973dca4-5ce8-40b4-8811-248780acf7c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:20.094078 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e973dca4-5ce8-40b4-8811-248780acf7c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:20.096199 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e973dca4-5ce8-40b4-8811-248780acf7c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:20.098437 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e973dca4-5ce8-40b4-8811-248780acf7c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.167570 Jul 29 11:49:20.099290 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 194/374] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:19 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:49:20.845860 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-508d546a-66f3-4987-baab-a2e9b3935b1b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:20.846657 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-508d546a-66f3-4987-baab-a2e9b3935b1b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:20.853760 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-508d546a-66f3-4987-baab-a2e9b3935b1b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:20.854108 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-508d546a-66f3-4987-baab-a2e9b3935b1b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:20.855448 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-508d546a-66f3-4987-baab-a2e9b3935b1b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:20.855983 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-508d546a-66f3-4987-baab-a2e9b3935b1b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:20.990856 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-508d546a-66f3-4987-baab-a2e9b3935b1b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:20.998189 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-508d546a-66f3-4987-baab-a2e9b3935b1b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.156355 Jul 29 11:49:20.998747 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 181/375] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:20 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:21.120655 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-cfe0e7c3-97f3-4a25-a54b-c6a5c928ec28 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:21.121302 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-cfe0e7c3-97f3-4a25-a54b-c6a5c928ec28 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:21.127771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cfe0e7c3-97f3-4a25-a54b-c6a5c928ec28 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:21.128260 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cfe0e7c3-97f3-4a25-a54b-c6a5c928ec28 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:21.129012 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cfe0e7c3-97f3-4a25-a54b-c6a5c928ec28 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:21.129462 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cfe0e7c3-97f3-4a25-a54b-c6a5c928ec28 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:21.258588 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-cfe0e7c3-97f3-4a25-a54b-c6a5c928ec28 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:21.267438 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-cfe0e7c3-97f3-4a25-a54b-c6a5c928ec28 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:21.268926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-cfe0e7c3-97f3-4a25-a54b-c6a5c928ec28 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:21.270134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-cfe0e7c3-97f3-4a25-a54b-c6a5c928ec28 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.153511 Jul 29 11:49:21.270689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 195/376] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:21 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:22.019006 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-b96cf860-f328-4b18-962b-0df1cc043d53 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:22.019624 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-b96cf860-f328-4b18-962b-0df1cc043d53 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:22.026271 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b96cf860-f328-4b18-962b-0df1cc043d53 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:22.026726 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b96cf860-f328-4b18-962b-0df1cc043d53 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:22.027690 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b96cf860-f328-4b18-962b-0df1cc043d53 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:22.028133 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b96cf860-f328-4b18-962b-0df1cc043d53 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:22.159998 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-b96cf860-f328-4b18-962b-0df1cc043d53 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:22.168141 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-b96cf860-f328-4b18-962b-0df1cc043d53 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1367 microversion: 2.1 time: 0.152979 Jul 29 11:49:22.168700 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 182/377] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:22 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:49:22.294514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b3830501-47f1-4d86-b4fd-7570914d0399 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:22.295964 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b3830501-47f1-4d86-b4fd-7570914d0399 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:22.304139 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b3830501-47f1-4d86-b4fd-7570914d0399 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:22.304604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b3830501-47f1-4d86-b4fd-7570914d0399 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:22.305381 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b3830501-47f1-4d86-b4fd-7570914d0399 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:22.305925 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b3830501-47f1-4d86-b4fd-7570914d0399 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:22.312578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=100 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:22.454354 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b3830501-47f1-4d86-b4fd-7570914d0399 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:22.462883 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b3830501-47f1-4d86-b4fd-7570914d0399 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:22.465036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b3830501-47f1-4d86-b4fd-7570914d0399 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:22.466231 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b3830501-47f1-4d86-b4fd-7570914d0399 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.176471 Jul 29 11:49:22.466801 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 196/378] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:22 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:23.190687 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5f9c69a7-e484-42c8-8464-75ce5ddb9af9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:23.192022 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-5f9c69a7-e484-42c8-8464-75ce5ddb9af9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:23.198880 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5f9c69a7-e484-42c8-8464-75ce5ddb9af9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:23.199337 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5f9c69a7-e484-42c8-8464-75ce5ddb9af9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:23.200101 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5f9c69a7-e484-42c8-8464-75ce5ddb9af9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:23.200534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5f9c69a7-e484-42c8-8464-75ce5ddb9af9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:23.332036 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-5f9c69a7-e484-42c8-8464-75ce5ddb9af9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:23.340547 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-5f9c69a7-e484-42c8-8464-75ce5ddb9af9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1557 microversion: 2.1 time: 0.155075 Jul 29 11:49:23.341111 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 183/379] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:23 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:23.360958 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-27a6c066-bded-4072-80b3-15504789c00e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:23.361505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-27a6c066-bded-4072-80b3-15504789c00e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:23.368096 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-27a6c066-bded-4072-80b3-15504789c00e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:23.368543 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-27a6c066-bded-4072-80b3-15504789c00e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:23.369306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-27a6c066-bded-4072-80b3-15504789c00e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:23.369773 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-27a6c066-bded-4072-80b3-15504789c00e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:23.450258 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-27a6c066-bded-4072-80b3-15504789c00e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093096 Jul 29 11:49:23.450851 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 197/380] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Jul 29 11:49:23 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:49:23.483977 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-84a229c7-3545-4456-9095-c8c21fa7e0ba tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:23.484483 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-84a229c7-3545-4456-9095-c8c21fa7e0ba tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:23.490235 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d747ce76-21aa-499a-a97c-de9dbc6b97ea tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:23.490890 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-84a229c7-3545-4456-9095-c8c21fa7e0ba tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:23.491013 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d747ce76-21aa-499a-a97c-de9dbc6b97ea tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:23.491355 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-84a229c7-3545-4456-9095-c8c21fa7e0ba tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:23.492131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-84a229c7-3545-4456-9095-c8c21fa7e0ba tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:23.492759 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-84a229c7-3545-4456-9095-c8c21fa7e0ba tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:23.497733 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d747ce76-21aa-499a-a97c-de9dbc6b97ea tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:23.498296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d747ce76-21aa-499a-a97c-de9dbc6b97ea tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:23.499147 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d747ce76-21aa-499a-a97c-de9dbc6b97ea tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:23.499707 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d747ce76-21aa-499a-a97c-de9dbc6b97ea tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:23.520713 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-84a229c7-3545-4456-9095-c8c21fa7e0ba tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Going to try to terminate instance {{(pid=129585) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:49:23.600676 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-84a229c7-3545-4456-9095-c8c21fa7e0ba tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 204 len: 0 microversion: 2.1 time: 0.120785 Jul 29 11:49:23.604982 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 184/381] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:49:23 2022] DELETE /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:49:23.611821 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-530be648-f219-4363-8634-049c765154f3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:23.612512 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-530be648-f219-4363-8634-049c765154f3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:23.618359 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-530be648-f219-4363-8634-049c765154f3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:23.618805 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-530be648-f219-4363-8634-049c765154f3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:23.619561 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-530be648-f219-4363-8634-049c765154f3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:23.620064 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-530be648-f219-4363-8634-049c765154f3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:23.790742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d747ce76-21aa-499a-a97c-de9dbc6b97ea tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:23.799315 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d747ce76-21aa-499a-a97c-de9dbc6b97ea tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:23.800809 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d747ce76-21aa-499a-a97c-de9dbc6b97ea tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:23.801988 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d747ce76-21aa-499a-a97c-de9dbc6b97ea tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.315810 Jul 29 11:49:23.802529 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 198/382] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:23 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:23.878532 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-530be648-f219-4363-8634-049c765154f3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:23.886936 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-530be648-f219-4363-8634-049c765154f3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1515 microversion: 2.1 time: 0.280527 Jul 29 11:49:23.887508 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 185/383] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:23 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1515 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:24.540257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-29b5ecff-0c36-4369-992c-a7675c1fdc22 req-1b78a897-7029-4755-9370-67713b5ae7ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fca404e-1bae-45f1-b4c7-0f1363d90a44", "tag": "4320296e-8fd1-4e24-b644-cad52e9c4572"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:49:24.550697 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-29b5ecff-0c36-4369-992c-a7675c1fdc22 req-1b78a897-7029-4755-9370-67713b5ae7ab service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:24.551219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-29b5ecff-0c36-4369-992c-a7675c1fdc22 req-1b78a897-7029-4755-9370-67713b5ae7ab service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:24.563172 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-29b5ecff-0c36-4369-992c-a7675c1fdc22 req-1b78a897-7029-4755-9370-67713b5ae7ab service nova] Creating event network-changed:4320296e-8fd1-4e24-b644-cad52e9c4572 for instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 on hv-cinder-83754 Jul 29 11:49:24.568251 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-29b5ecff-0c36-4369-992c-a7675c1fdc22 req-1b78a897-7029-4755-9370-67713b5ae7ab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031571 Jul 29 11:49:24.568932 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 199/384] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:49:24.825644 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4384b6af-66c5-4917-9cea-eb689b325a79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:24.826296 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4384b6af-66c5-4917-9cea-eb689b325a79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:24.832804 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4384b6af-66c5-4917-9cea-eb689b325a79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:24.833269 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4384b6af-66c5-4917-9cea-eb689b325a79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:24.834083 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4384b6af-66c5-4917-9cea-eb689b325a79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:24.834527 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4384b6af-66c5-4917-9cea-eb689b325a79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:24.909862 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d92ba666-34e1-424d-8f09-2ad0408a90dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:24.910575 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d92ba666-34e1-424d-8f09-2ad0408a90dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:24.917563 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d92ba666-34e1-424d-8f09-2ad0408a90dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:24.917960 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d92ba666-34e1-424d-8f09-2ad0408a90dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:24.918744 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d92ba666-34e1-424d-8f09-2ad0408a90dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:24.919182 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d92ba666-34e1-424d-8f09-2ad0408a90dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:25.000906 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-4384b6af-66c5-4917-9cea-eb689b325a79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:25.011847 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-4384b6af-66c5-4917-9cea-eb689b325a79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:25.013533 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-4384b6af-66c5-4917-9cea-eb689b325a79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:25.014783 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4384b6af-66c5-4917-9cea-eb689b325a79 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.193430 Jul 29 11:49:25.015760 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 186/385] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:24 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:25.066297 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d92ba666-34e1-424d-8f09-2ad0408a90dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:25.074657 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d92ba666-34e1-424d-8f09-2ad0408a90dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1515 microversion: 2.1 time: 0.169306 Jul 29 11:49:25.075219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 200/386] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:24 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:26.038373 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-731d60ce-6663-4028-a2f4-dd9e1883c334 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:26.039022 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-731d60ce-6663-4028-a2f4-dd9e1883c334 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:26.046110 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-731d60ce-6663-4028-a2f4-dd9e1883c334 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:26.046578 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-731d60ce-6663-4028-a2f4-dd9e1883c334 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:26.047351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-731d60ce-6663-4028-a2f4-dd9e1883c334 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:26.047796 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-731d60ce-6663-4028-a2f4-dd9e1883c334 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:26.096420 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-54b5f773-03b4-415b-a20c-279ec58f2534 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:26.097087 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-54b5f773-03b4-415b-a20c-279ec58f2534 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:26.099930 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=68 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:26.106038 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-54b5f773-03b4-415b-a20c-279ec58f2534 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:26.106492 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-54b5f773-03b4-415b-a20c-279ec58f2534 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:26.107267 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-54b5f773-03b4-415b-a20c-279ec58f2534 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:26.107846 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-54b5f773-03b4-415b-a20c-279ec58f2534 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:26.250588 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-731d60ce-6663-4028-a2f4-dd9e1883c334 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:26.273672 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-731d60ce-6663-4028-a2f4-dd9e1883c334 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:26.275325 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-731d60ce-6663-4028-a2f4-dd9e1883c334 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:26.278314 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-731d60ce-6663-4028-a2f4-dd9e1883c334 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.243818 Jul 29 11:49:26.300189 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 187/387] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:26 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:26.335770 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-54b5f773-03b4-415b-a20c-279ec58f2534 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:26.357577 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-54b5f773-03b4-415b-a20c-279ec58f2534 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 200 len: 1515 microversion: 2.1 time: 0.265218 Jul 29 11:49:26.358161 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 201/388] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:26 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 1515 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:49:26.366087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-5faec799-cab7-41ea-ae9d-c01c0e3f6e53 req-f8ff4d8b-5f47-4afd-a102-575e74fe9af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7529e35b-c6b2-4c8f-896c-fd2060f91657", "name": "network-vif-deleted", "tag": "f123c03d-aaa7-4c59-a7db-11c40621e5c6"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:49:26.376727 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-5faec799-cab7-41ea-ae9d-c01c0e3f6e53 req-f8ff4d8b-5f47-4afd-a102-575e74fe9af7 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:26.377177 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-5faec799-cab7-41ea-ae9d-c01c0e3f6e53 req-f8ff4d8b-5f47-4afd-a102-575e74fe9af7 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:26.390143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-5faec799-cab7-41ea-ae9d-c01c0e3f6e53 req-f8ff4d8b-5f47-4afd-a102-575e74fe9af7 service nova] Creating event network-vif-deleted:f123c03d-aaa7-4c59-a7db-11c40621e5c6 for instance 7529e35b-c6b2-4c8f-896c-fd2060f91657 on hv-cinder-83754 Jul 29 11:49:26.395278 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-5faec799-cab7-41ea-ae9d-c01c0e3f6e53 req-f8ff4d8b-5f47-4afd-a102-575e74fe9af7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032787 Jul 29 11:49:26.395876 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 188/389] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:49:27.308497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-610b09ad-b33e-4054-a587-fa29bc40ca7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:27.309110 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-610b09ad-b33e-4054-a587-fa29bc40ca7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:27.315682 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-610b09ad-b33e-4054-a587-fa29bc40ca7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:27.316133 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-610b09ad-b33e-4054-a587-fa29bc40ca7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:27.316897 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-610b09ad-b33e-4054-a587-fa29bc40ca7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:27.317335 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-610b09ad-b33e-4054-a587-fa29bc40ca7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:27.379983 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ecc181be-0385-48ae-a820-a28d1c16aab6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:27.380753 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ecc181be-0385-48ae-a820-a28d1c16aab6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 7529e35b-c6b2-4c8f-896c-fd2060f91657] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:27.388479 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ecc181be-0385-48ae-a820-a28d1c16aab6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:27.388936 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ecc181be-0385-48ae-a820-a28d1c16aab6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:27.389746 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ecc181be-0385-48ae-a820-a28d1c16aab6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:27.390196 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ecc181be-0385-48ae-a820-a28d1c16aab6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:27.404167 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-ecc181be-0385-48ae-a820-a28d1c16aab6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] HTTP exception thrown: Instance 7529e35b-c6b2-4c8f-896c-fd2060f91657 could not be found. Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ecc181be-0385-48ae-a820-a28d1c16aab6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Request method failure captured: Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 HTTP/1.1 Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48jp1w-Ot_13ELJmVkWyuwS8QY9NYZ_-lWO7kdtaPFzD7xuNHiv5UQJdybPL5_uTSYP3FJ5AfobmEt_WZJcEv_4cC0c_Ugztzus4dBNgWTCNY1u20QO9XpWSCzRy0xibEJbvL0KiS6-NovWi8deyVgmBHex8keYqqvxEXNxl9NPFo-8 Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 1658d63aa1b54aa5a36754e83179e317 Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1487326111 Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:49:27.405864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:49:27.407336 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1658d63aa1b54aa5a36754e83179e317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1658d63aa1b54aa5a36754e83179e317", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1658d63aa1b54aa5a36754e83179e317"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1658d63aa1b54aa5a36754e83179e317"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:49:27.407336 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-VolumesSnapshotTestJSON-1487326111 Jul 29 11:49:27.407336 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 1658d63aa1b54aa5a36754e83179e317 Jul 29 11:49:27.407336 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1487326111 Jul 29 11:49:27.407336 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-VolumesSnapshotTestJSON-1487326111-project Jul 29 11:49:27.407336 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:49:27.407336 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:49:27.407336 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 0c22bac56ed1472a9b2e7b6943736333 Jul 29 11:49:27.407336 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-VolumesSnapshotTestJSON-1487326111-project Jul 29 11:49:27.407336 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:49:27.407336 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance 7529e35b-c6b2-4c8f-896c-fd2060f91657 could not be found. Jul 29 11:49:27.407336 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': '7529e35b-c6b2-4c8f-896c-fd2060f91657'} Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7529e35b-c6b2-4c8f-896c-fd2060f91657 could not be found. Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:49:27.408100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7529e35b-c6b2-4c8f-896c-fd2060f91657 could not be found. Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7529e35b-c6b2-4c8f-896c-fd2060f91657 could not be found. Jul 29 11:49:27.409294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:49:27.410415 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ecc181be-0385-48ae-a820-a28d1c16aab6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Returning 404 to user: Instance 7529e35b-c6b2-4c8f-896c-fd2060f91657 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:49:27.410415 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ecc181be-0385-48ae-a820-a28d1c16aab6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657" status: 404 len: 111 microversion: 2.1 time: 0.032382 Jul 29 11:49:27.410415 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 189/390] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:27 2022] GET /compute/v2.1/servers/7529e35b-c6b2-4c8f-896c-fd2060f91657 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 11:49:27.450261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-610b09ad-b33e-4054-a587-fa29bc40ca7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:27.458604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-610b09ad-b33e-4054-a587-fa29bc40ca7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:27.460107 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-610b09ad-b33e-4054-a587-fa29bc40ca7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:27.461276 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-610b09ad-b33e-4054-a587-fa29bc40ca7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.157257 Jul 29 11:49:27.461866 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 202/391] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:27 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:28.485483 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-db6463cf-934e-43a3-8750-f00d373bd283 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:28.486036 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-db6463cf-934e-43a3-8750-f00d373bd283 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:28.492552 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-db6463cf-934e-43a3-8750-f00d373bd283 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:28.493002 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-db6463cf-934e-43a3-8750-f00d373bd283 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:28.493790 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-db6463cf-934e-43a3-8750-f00d373bd283 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:28.494227 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-db6463cf-934e-43a3-8750-f00d373bd283 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:28.624468 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-db6463cf-934e-43a3-8750-f00d373bd283 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:28.633063 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-db6463cf-934e-43a3-8750-f00d373bd283 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:28.634609 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-db6463cf-934e-43a3-8750-f00d373bd283 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:28.636887 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-db6463cf-934e-43a3-8750-f00d373bd283 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.155348 Jul 29 11:49:28.637461 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 190/392] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:28 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:29.659246 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-09bf8d90-09d5-4ec2-a49c-a5243a126ad5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:29.659854 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-09bf8d90-09d5-4ec2-a49c-a5243a126ad5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:29.666312 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-09bf8d90-09d5-4ec2-a49c-a5243a126ad5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:29.667284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-09bf8d90-09d5-4ec2-a49c-a5243a126ad5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:29.668043 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-09bf8d90-09d5-4ec2-a49c-a5243a126ad5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:29.668475 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-09bf8d90-09d5-4ec2-a49c-a5243a126ad5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:29.794509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-09bf8d90-09d5-4ec2-a49c-a5243a126ad5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:29.802839 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-09bf8d90-09d5-4ec2-a49c-a5243a126ad5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:29.804335 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-09bf8d90-09d5-4ec2-a49c-a5243a126ad5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:29.805515 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-09bf8d90-09d5-4ec2-a49c-a5243a126ad5 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.150109 Jul 29 11:49:29.806079 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 203/393] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:29 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:30.828286 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-0aec3eb5-b24a-4aff-9822-c0a41d87ad82 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:30.828835 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-0aec3eb5-b24a-4aff-9822-c0a41d87ad82 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:30.835296 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0aec3eb5-b24a-4aff-9822-c0a41d87ad82 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:30.835744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0aec3eb5-b24a-4aff-9822-c0a41d87ad82 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:30.836531 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0aec3eb5-b24a-4aff-9822-c0a41d87ad82 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:30.837010 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0aec3eb5-b24a-4aff-9822-c0a41d87ad82 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:30.968668 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-0aec3eb5-b24a-4aff-9822-c0a41d87ad82 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:30.977274 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-0aec3eb5-b24a-4aff-9822-c0a41d87ad82 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:30.978840 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-0aec3eb5-b24a-4aff-9822-c0a41d87ad82 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:30.980649 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-0aec3eb5-b24a-4aff-9822-c0a41d87ad82 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.156381 Jul 29 11:49:30.981207 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 191/394] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:30 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:32.003859 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6c19514f-ef48-47f6-8f99-027500c27760 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:32.004493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6c19514f-ef48-47f6-8f99-027500c27760 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:32.011249 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6c19514f-ef48-47f6-8f99-027500c27760 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:32.011691 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6c19514f-ef48-47f6-8f99-027500c27760 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:32.012516 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6c19514f-ef48-47f6-8f99-027500c27760 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:32.012886 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6c19514f-ef48-47f6-8f99-027500c27760 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:32.151045 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6c19514f-ef48-47f6-8f99-027500c27760 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:32.160114 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6c19514f-ef48-47f6-8f99-027500c27760 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:32.161624 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6c19514f-ef48-47f6-8f99-027500c27760 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:32.162777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-6c19514f-ef48-47f6-8f99-027500c27760 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.163164 Jul 29 11:49:32.163328 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 204/395] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:31 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:33.185015 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-50dba4cb-2829-4ed9-9486-e69e8f0698bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:33.185775 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-50dba4cb-2829-4ed9-9486-e69e8f0698bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:33.188277 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:33.195393 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-50dba4cb-2829-4ed9-9486-e69e8f0698bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:33.195850 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-50dba4cb-2829-4ed9-9486-e69e8f0698bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:33.196672 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-50dba4cb-2829-4ed9-9486-e69e8f0698bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:33.197205 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-50dba4cb-2829-4ed9-9486-e69e8f0698bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:33.327360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-50dba4cb-2829-4ed9-9486-e69e8f0698bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:33.335744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-50dba4cb-2829-4ed9-9486-e69e8f0698bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:33.337256 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-50dba4cb-2829-4ed9-9486-e69e8f0698bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:33.338449 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-50dba4cb-2829-4ed9-9486-e69e8f0698bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.158053 Jul 29 11:49:33.338999 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 192/396] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:33 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:34.361503 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-73f27a74-8add-4cd1-911d-22558e8aeb13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:34.362044 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-73f27a74-8add-4cd1-911d-22558e8aeb13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:34.369076 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-73f27a74-8add-4cd1-911d-22558e8aeb13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:34.369573 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-73f27a74-8add-4cd1-911d-22558e8aeb13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:34.370334 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-73f27a74-8add-4cd1-911d-22558e8aeb13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:34.370817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-73f27a74-8add-4cd1-911d-22558e8aeb13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:34.497966 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-73f27a74-8add-4cd1-911d-22558e8aeb13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:34.506309 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-73f27a74-8add-4cd1-911d-22558e8aeb13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:34.507807 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-73f27a74-8add-4cd1-911d-22558e8aeb13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:34.508953 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-73f27a74-8add-4cd1-911d-22558e8aeb13 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.151460 Jul 29 11:49:34.509537 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 205/397] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:34 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:49:35.532693 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-cbc38196-529f-4197-8864-0857d143b6f7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:35.533315 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-cbc38196-529f-4197-8864-0857d143b6f7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:35.539985 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cbc38196-529f-4197-8864-0857d143b6f7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:35.540440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cbc38196-529f-4197-8864-0857d143b6f7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:35.541205 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cbc38196-529f-4197-8864-0857d143b6f7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:35.541684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cbc38196-529f-4197-8864-0857d143b6f7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:35.556786 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:35.675188 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-cbc38196-529f-4197-8864-0857d143b6f7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:35.683646 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-cbc38196-529f-4197-8864-0857d143b6f7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:35.685154 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-cbc38196-529f-4197-8864-0857d143b6f7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:35.686348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-cbc38196-529f-4197-8864-0857d143b6f7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.157636 Jul 29 11:49:35.686932 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 193/398] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:35 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:36.479168 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-e6be004e-60a7-40a9-b3ae-181c1f6a9257 req-5427050c-7e05-4811-bae5-ec47d5fada97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7bd0b02-2726-4432-a6a1-53035c9a1978", "name": "network-vif-plugged", "status": "completed", "tag": "fb1642b2-a468-43c6-8233-7e7bcc25cfcd"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:49:36.492003 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-e6be004e-60a7-40a9-b3ae-181c1f6a9257 req-5427050c-7e05-4811-bae5-ec47d5fada97 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:36.492453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-e6be004e-60a7-40a9-b3ae-181c1f6a9257 req-5427050c-7e05-4811-bae5-ec47d5fada97 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:36.504468 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-e6be004e-60a7-40a9-b3ae-181c1f6a9257 req-5427050c-7e05-4811-bae5-ec47d5fada97 service nova] Creating event network-vif-plugged:fb1642b2-a468-43c6-8233-7e7bcc25cfcd for instance d7bd0b02-2726-4432-a6a1-53035c9a1978 on hv-cinder-83754 Jul 29 11:49:36.509731 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-e6be004e-60a7-40a9-b3ae-181c1f6a9257 req-5427050c-7e05-4811-bae5-ec47d5fada97 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034462 Jul 29 11:49:36.510770 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 206/399] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:49:36.709825 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-39edfe67-e8c7-4449-9bb2-960d563f99ab tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:36.710372 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-39edfe67-e8c7-4449-9bb2-960d563f99ab tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:36.717573 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-39edfe67-e8c7-4449-9bb2-960d563f99ab tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:36.718023 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-39edfe67-e8c7-4449-9bb2-960d563f99ab tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:36.718772 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-39edfe67-e8c7-4449-9bb2-960d563f99ab tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:36.719205 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-39edfe67-e8c7-4449-9bb2-960d563f99ab tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:36.852192 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-39edfe67-e8c7-4449-9bb2-960d563f99ab tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:36.861166 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-39edfe67-e8c7-4449-9bb2-960d563f99ab tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:36.862701 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-39edfe67-e8c7-4449-9bb2-960d563f99ab tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:36.863854 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-39edfe67-e8c7-4449-9bb2-960d563f99ab tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.158041 Jul 29 11:49:36.864412 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 194/400] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:36 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:37.303844 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b39c0eaf-426b-40f3-834f-15d19fbc6b41 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2135074879", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452", "networks": [{"uuid": "4993d81f-11a0-4255-ad5a-9700754167c4"}]}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:49:37.358002 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.network.neutron [None req-b39c0eaf-426b-40f3-834f-15d19fbc6b41 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] validate_networks() for [('4993d81f-11a0-4255-ad5a-9700754167c4', None, None, None, None, None)] {{(pid=129584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:49:37.886483 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-3b81a8c7-f55a-4c15-b481-fc15bd8966de tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:37.887106 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-3b81a8c7-f55a-4c15-b481-fc15bd8966de tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:37.894427 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3b81a8c7-f55a-4c15-b481-fc15bd8966de tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:37.894888 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3b81a8c7-f55a-4c15-b481-fc15bd8966de tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:37.895674 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3b81a8c7-f55a-4c15-b481-fc15bd8966de tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:37.896118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3b81a8c7-f55a-4c15-b481-fc15bd8966de tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:37.944161 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-b39c0eaf-426b-40f3-834f-15d19fbc6b41 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Flavor limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:49:37.944624 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-b39c0eaf-426b-40f3-834f-15d19fbc6b41 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Image limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:49:37.945031 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-b39c0eaf-426b-40f3-834f-15d19fbc6b41 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Flavor pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:49:37.945458 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-b39c0eaf-426b-40f3-834f-15d19fbc6b41 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Image pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:49:37.945869 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-b39c0eaf-426b-40f3-834f-15d19fbc6b41 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:49:37.954676 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b39c0eaf-426b-40f3-834f-15d19fbc6b41 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:37.955118 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b39c0eaf-426b-40f3-834f-15d19fbc6b41 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:37.955902 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b39c0eaf-426b-40f3-834f-15d19fbc6b41 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:37.956334 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b39c0eaf-426b-40f3-834f-15d19fbc6b41 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:37.972992 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-b39c0eaf-426b-40f3-834f-15d19fbc6b41 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Getting quotas for project 1658d63aa1b54aa5a36754e83179e317. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:49:37.977017 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-b39c0eaf-426b-40f3-834f-15d19fbc6b41 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Getting quotas for user 0c22bac56ed1472a9b2e7b6943736333 and project 1658d63aa1b54aa5a36754e83179e317. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:49:37.988460 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b39c0eaf-426b-40f3-834f-15d19fbc6b41 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Going to run 1 instances... {{(pid=129584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:49:37.990851 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b39c0eaf-426b-40f3-834f-15d19fbc6b41 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:49:38.031649 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-3b81a8c7-f55a-4c15-b481-fc15bd8966de tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:38.036273 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b39c0eaf-426b-40f3-834f-15d19fbc6b41 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736467 Jul 29 11:49:38.036917 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 207/401] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:49:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 11:49:38.040676 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-3b81a8c7-f55a-4c15-b481-fc15bd8966de tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:38.042860 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-3b81a8c7-f55a-4c15-b481-fc15bd8966de tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:38.044428 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-3b81a8c7-f55a-4c15-b481-fc15bd8966de tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.162223 Jul 29 11:49:38.045060 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 195/402] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:37 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:38.048201 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ea9a684c-4239-4305-9e88-09448d909a81 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:38.048812 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ea9a684c-4239-4305-9e88-09448d909a81 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:38.101495 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ea9a684c-4239-4305-9e88-09448d909a81 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:38.109138 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ea9a684c-4239-4305-9e88-09448d909a81 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 200 len: 1219 microversion: 2.1 time: 0.064674 Jul 29 11:49:38.109746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 208/403] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:38 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:49:39.067779 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e38b0539-ff63-421d-ad0e-c2526a5031a2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:39.068415 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e38b0539-ff63-421d-ad0e-c2526a5031a2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:39.094137 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e38b0539-ff63-421d-ad0e-c2526a5031a2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:39.094503 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e38b0539-ff63-421d-ad0e-c2526a5031a2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:39.095395 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e38b0539-ff63-421d-ad0e-c2526a5031a2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:39.095756 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e38b0539-ff63-421d-ad0e-c2526a5031a2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:39.130814 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c7da30e0-4242-47fe-82fc-52777ace2a7a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:39.131437 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c7da30e0-4242-47fe-82fc-52777ace2a7a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:39.140096 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c7da30e0-4242-47fe-82fc-52777ace2a7a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:39.140568 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c7da30e0-4242-47fe-82fc-52777ace2a7a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:39.141586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c7da30e0-4242-47fe-82fc-52777ace2a7a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:39.142028 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c7da30e0-4242-47fe-82fc-52777ace2a7a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:39.220819 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c7da30e0-4242-47fe-82fc-52777ace2a7a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:39.229992 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c7da30e0-4242-47fe-82fc-52777ace2a7a tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 200 len: 1215 microversion: 2.1 time: 0.103588 Jul 29 11:49:39.243336 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 209/404] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:39 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 1215 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:39.290837 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e38b0539-ff63-421d-ad0e-c2526a5031a2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:39.300450 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e38b0539-ff63-421d-ad0e-c2526a5031a2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:39.301995 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e38b0539-ff63-421d-ad0e-c2526a5031a2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:39.303171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e38b0539-ff63-421d-ad0e-c2526a5031a2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1809 microversion: 2.20 time: 0.239394 Jul 29 11:49:39.303738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 196/405] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:39 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:49:40.250996 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ba35765c-9e42-4d2b-b3fd-3c3125717b51 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:40.251629 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ba35765c-9e42-4d2b-b3fd-3c3125717b51 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:40.257987 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ba35765c-9e42-4d2b-b3fd-3c3125717b51 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:40.258431 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ba35765c-9e42-4d2b-b3fd-3c3125717b51 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:40.259187 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ba35765c-9e42-4d2b-b3fd-3c3125717b51 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:40.259617 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ba35765c-9e42-4d2b-b3fd-3c3125717b51 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:40.327298 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-b5ef9adf-c163-4a42-a0ce-382de304e0fe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:40.327925 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-b5ef9adf-c163-4a42-a0ce-382de304e0fe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:40.334647 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b5ef9adf-c163-4a42-a0ce-382de304e0fe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:40.335556 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b5ef9adf-c163-4a42-a0ce-382de304e0fe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:40.335892 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b5ef9adf-c163-4a42-a0ce-382de304e0fe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:40.336382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b5ef9adf-c163-4a42-a0ce-382de304e0fe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:40.338150 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ba35765c-9e42-4d2b-b3fd-3c3125717b51 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:40.346368 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ba35765c-9e42-4d2b-b3fd-3c3125717b51 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 200 len: 1277 microversion: 2.1 time: 0.099020 Jul 29 11:49:40.347496 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 210/406] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:40 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:40.569812 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-b5ef9adf-c163-4a42-a0ce-382de304e0fe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:40.578366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-b5ef9adf-c163-4a42-a0ce-382de304e0fe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:40.579889 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-b5ef9adf-c163-4a42-a0ce-382de304e0fe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:40.581071 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-b5ef9adf-c163-4a42-a0ce-382de304e0fe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1796 microversion: 2.20 time: 0.257801 Jul 29 11:49:40.581663 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 197/407] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:49:40 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1796 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:49:41.208467 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-30311011-a4b6-46b7-a64f-11fc3bdb8a5f req-a69c4a81-2bf0-4eb2-a9b0-04a0f1202150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839a7b01-ae71-4df9-8f76-2842e0c61798", "tag": "2aae6285-c16d-4c67-a214-8f39a536fcca"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:49:41.219348 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-30311011-a4b6-46b7-a64f-11fc3bdb8a5f req-a69c4a81-2bf0-4eb2-a9b0-04a0f1202150 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:41.219814 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-30311011-a4b6-46b7-a64f-11fc3bdb8a5f req-a69c4a81-2bf0-4eb2-a9b0-04a0f1202150 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:41.232369 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-30311011-a4b6-46b7-a64f-11fc3bdb8a5f req-a69c4a81-2bf0-4eb2-a9b0-04a0f1202150 service nova] Creating event network-changed:2aae6285-c16d-4c67-a214-8f39a536fcca for instance 839a7b01-ae71-4df9-8f76-2842e0c61798 on hv-cinder-83754 Jul 29 11:49:41.237000 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-30311011-a4b6-46b7-a64f-11fc3bdb8a5f req-a69c4a81-2bf0-4eb2-a9b0-04a0f1202150 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032308 Jul 29 11:49:41.237949 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 211/408] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:49:41.368421 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-07385db2-8000-4fea-9045-0cfc5c5da965 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:41.369098 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-07385db2-8000-4fea-9045-0cfc5c5da965 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:41.376111 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-07385db2-8000-4fea-9045-0cfc5c5da965 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:41.376564 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-07385db2-8000-4fea-9045-0cfc5c5da965 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:41.377338 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-07385db2-8000-4fea-9045-0cfc5c5da965 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:41.377794 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-07385db2-8000-4fea-9045-0cfc5c5da965 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:41.591099 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-07385db2-8000-4fea-9045-0cfc5c5da965 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:41.598562 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-07385db2-8000-4fea-9045-0cfc5c5da965 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 200 len: 1319 microversion: 2.1 time: 0.234121 Jul 29 11:49:41.599147 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 198/409] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:41 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:42.620522 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f4872d81-c25a-43a1-b2e9-199219da6cc3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:42.621247 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f4872d81-c25a-43a1-b2e9-199219da6cc3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:42.627755 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f4872d81-c25a-43a1-b2e9-199219da6cc3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:42.628215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f4872d81-c25a-43a1-b2e9-199219da6cc3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:42.628980 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f4872d81-c25a-43a1-b2e9-199219da6cc3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:42.629440 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f4872d81-c25a-43a1-b2e9-199219da6cc3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:42.757945 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f4872d81-c25a-43a1-b2e9-199219da6cc3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:42.766221 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f4872d81-c25a-43a1-b2e9-199219da6cc3 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 200 len: 1319 microversion: 2.1 time: 0.150775 Jul 29 11:49:42.766804 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 212/410] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:42 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:43.786678 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-80d928d2-8ecc-430f-8b17-fed2aaa2b669 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:43.787225 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-80d928d2-8ecc-430f-8b17-fed2aaa2b669 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:43.794969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-80d928d2-8ecc-430f-8b17-fed2aaa2b669 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:43.795427 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-80d928d2-8ecc-430f-8b17-fed2aaa2b669 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:43.796211 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-80d928d2-8ecc-430f-8b17-fed2aaa2b669 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:43.796654 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-80d928d2-8ecc-430f-8b17-fed2aaa2b669 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:43.926046 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-80d928d2-8ecc-430f-8b17-fed2aaa2b669 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:43.933333 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-80d928d2-8ecc-430f-8b17-fed2aaa2b669 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 200 len: 1319 microversion: 2.1 time: 0.150560 Jul 29 11:49:43.933928 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 199/411] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:43 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:44.953959 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-62b3f01d-222a-4555-afa2-91d1906723b1 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:44.954570 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-62b3f01d-222a-4555-afa2-91d1906723b1 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:44.960968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-62b3f01d-222a-4555-afa2-91d1906723b1 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:44.961406 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-62b3f01d-222a-4555-afa2-91d1906723b1 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:44.962195 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-62b3f01d-222a-4555-afa2-91d1906723b1 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:44.962620 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-62b3f01d-222a-4555-afa2-91d1906723b1 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:45.093760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-62b3f01d-222a-4555-afa2-91d1906723b1 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:45.101068 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-62b3f01d-222a-4555-afa2-91d1906723b1 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 200 len: 1319 microversion: 2.1 time: 0.150943 Jul 29 11:49:45.101819 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 213/412] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:44 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:46.122840 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4351dcb2-c8c3-4ad3-a50a-45a8b07d8be6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:46.123453 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4351dcb2-c8c3-4ad3-a50a-45a8b07d8be6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:46.130004 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4351dcb2-c8c3-4ad3-a50a-45a8b07d8be6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:46.130460 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4351dcb2-c8c3-4ad3-a50a-45a8b07d8be6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:46.131228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4351dcb2-c8c3-4ad3-a50a-45a8b07d8be6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:46.131665 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4351dcb2-c8c3-4ad3-a50a-45a8b07d8be6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:46.264513 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-4351dcb2-c8c3-4ad3-a50a-45a8b07d8be6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:46.271866 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4351dcb2-c8c3-4ad3-a50a-45a8b07d8be6 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 200 len: 1319 microversion: 2.1 time: 0.153583 Jul 29 11:49:46.272425 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 200/413] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:46 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:46.514652 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-b309c5a0-1f64-40c3-a306-b77a18c52dcf req-8face7ab-16ea-470a-ba45-0fe781cd9ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839a7b01-ae71-4df9-8f76-2842e0c61798", "name": "network-vif-plugged", "status": "completed", "tag": "2aae6285-c16d-4c67-a214-8f39a536fcca"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:49:46.524558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-b309c5a0-1f64-40c3-a306-b77a18c52dcf req-8face7ab-16ea-470a-ba45-0fe781cd9ce4 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:46.525004 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-b309c5a0-1f64-40c3-a306-b77a18c52dcf req-8face7ab-16ea-470a-ba45-0fe781cd9ce4 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:46.537209 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-b309c5a0-1f64-40c3-a306-b77a18c52dcf req-8face7ab-16ea-470a-ba45-0fe781cd9ce4 service nova] Creating event network-vif-plugged:2aae6285-c16d-4c67-a214-8f39a536fcca for instance 839a7b01-ae71-4df9-8f76-2842e0c61798 on hv-cinder-83754 Jul 29 11:49:46.542828 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-b309c5a0-1f64-40c3-a306-b77a18c52dcf req-8face7ab-16ea-470a-ba45-0fe781cd9ce4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031295 Jul 29 11:49:46.543423 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 214/414] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:49:47.124809 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4dd42882-4d2b-41f7-a176-5c1db01b8a45 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c877b70-645e-404e-92b9-880786582e41"}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:49:47.127177 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4dd42882-4d2b-41f7-a176-5c1db01b8a45 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:47.133623 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4dd42882-4d2b-41f7-a176-5c1db01b8a45 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:47.134071 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4dd42882-4d2b-41f7-a176-5c1db01b8a45 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:47.134826 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4dd42882-4d2b-41f7-a176-5c1db01b8a45 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:47.135257 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4dd42882-4d2b-41f7-a176-5c1db01b8a45 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:47.292131 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-aa86bb0f-a5d9-4037-9a54-52c96b1ed3fa tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:47.292814 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-aa86bb0f-a5d9-4037-9a54-52c96b1ed3fa tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:47.299009 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aa86bb0f-a5d9-4037-9a54-52c96b1ed3fa tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:47.299454 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aa86bb0f-a5d9-4037-9a54-52c96b1ed3fa tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:47.300209 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aa86bb0f-a5d9-4037-9a54-52c96b1ed3fa tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:47.300640 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aa86bb0f-a5d9-4037-9a54-52c96b1ed3fa tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:47.428185 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-aa86bb0f-a5d9-4037-9a54-52c96b1ed3fa tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:47.436275 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-aa86bb0f-a5d9-4037-9a54-52c96b1ed3fa tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 200 len: 1319 microversion: 2.1 time: 0.148256 Jul 29 11:49:47.436833 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 215/415] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:47 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:49:47.719163 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4dd42882-4d2b-41f7-a176-5c1db01b8a45 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "POST /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.598444 Jul 29 11:49:47.719760 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 201/416] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Jul 29 11:49:47 2022] POST /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/os-volume_attachments => generated 194 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:49:48.456817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-095f3ef6-8791-4714-88f3-7970802e8277 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:48.457406 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-095f3ef6-8791-4714-88f3-7970802e8277 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:48.459793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=2 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:48.460467 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=8 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:48.467134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-095f3ef6-8791-4714-88f3-7970802e8277 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:48.467589 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-095f3ef6-8791-4714-88f3-7970802e8277 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:48.468352 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-095f3ef6-8791-4714-88f3-7970802e8277 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:48.468788 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-095f3ef6-8791-4714-88f3-7970802e8277 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:48.600378 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-095f3ef6-8791-4714-88f3-7970802e8277 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:48.608098 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-095f3ef6-8791-4714-88f3-7970802e8277 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 200 len: 1509 microversion: 2.1 time: 0.155171 Jul 29 11:49:48.608662 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 216/417] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:48 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:48.628953 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9300dd5a-9e54-4342-b97f-9165ca017463 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3004286e-cb71-467e-8520-db7d4d12bea9", "device": "/dev/sdb"}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:49:48.631916 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9300dd5a-9e54-4342-b97f-9165ca017463 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:48.639207 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9300dd5a-9e54-4342-b97f-9165ca017463 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:48.639658 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9300dd5a-9e54-4342-b97f-9165ca017463 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:48.640410 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9300dd5a-9e54-4342-b97f-9165ca017463 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:48.640845 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9300dd5a-9e54-4342-b97f-9165ca017463 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:48.880374 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9300dd5a-9e54-4342-b97f-9165ca017463 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "POST /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255995 Jul 29 11:49:48.881110 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 202/418] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Jul 29 11:49:48 2022] POST /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:49:55.245542 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3d63eff4-9e5b-4c11-bda1-7cf8d9124e06 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:49:55.248984 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3d63eff4-9e5b-4c11-bda1-7cf8d9124e06 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:55.255914 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3d63eff4-9e5b-4c11-bda1-7cf8d9124e06 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:55.256361 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3d63eff4-9e5b-4c11-bda1-7cf8d9124e06 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:55.257118 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3d63eff4-9e5b-4c11-bda1-7cf8d9124e06 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:55.257584 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3d63eff4-9e5b-4c11-bda1-7cf8d9124e06 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:55.261483 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=98 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:55.281729 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-3d63eff4-9e5b-4c11-bda1-7cf8d9124e06 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lazy-loading 'flavor' on Instance uuid 51b4f838-c329-43d2-8448-82ad1ee8ad2a {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:49:55.403271 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3d63eff4-9e5b-4c11-bda1-7cf8d9124e06 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "POST /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/action" status: 200 len: 32 microversion: 2.1 time: 0.161655 Jul 29 11:49:55.403870 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 217/419] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Jul 29 11:49:55 2022] POST /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 11:49:55.414512 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-dddac7ea-592e-44be-8ef3-f352728c86dc tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:55.415809 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-dddac7ea-592e-44be-8ef3-f352728c86dc tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:55.422953 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-dddac7ea-592e-44be-8ef3-f352728c86dc tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:55.423551 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-dddac7ea-592e-44be-8ef3-f352728c86dc tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:55.424295 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-dddac7ea-592e-44be-8ef3-f352728c86dc tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:55.424746 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-dddac7ea-592e-44be-8ef3-f352728c86dc tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:55.642872 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-dddac7ea-592e-44be-8ef3-f352728c86dc tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:55.650979 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-dddac7ea-592e-44be-8ef3-f352728c86dc tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.241360 Jul 29 11:49:55.651543 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 203/420] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:55 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:56.673154 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-09017281-9adc-44b6-9fff-0a465e10fa49 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:56.673812 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-09017281-9adc-44b6-9fff-0a465e10fa49 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:56.675758 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:49:56.681199 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-09017281-9adc-44b6-9fff-0a465e10fa49 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:56.681685 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-09017281-9adc-44b6-9fff-0a465e10fa49 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:56.682459 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-09017281-9adc-44b6-9fff-0a465e10fa49 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:56.682903 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-09017281-9adc-44b6-9fff-0a465e10fa49 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:56.811495 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-09017281-9adc-44b6-9fff-0a465e10fa49 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:56.819308 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-09017281-9adc-44b6-9fff-0a465e10fa49 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.150911 Jul 29 11:49:56.819870 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 218/421] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:56 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:49:57.841408 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-7a3c029c-537c-499e-a1b0-c57f310e173f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:57.842057 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-7a3c029c-537c-499e-a1b0-c57f310e173f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:57.848603 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7a3c029c-537c-499e-a1b0-c57f310e173f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:57.849061 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7a3c029c-537c-499e-a1b0-c57f310e173f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:57.849860 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7a3c029c-537c-499e-a1b0-c57f310e173f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:57.850310 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7a3c029c-537c-499e-a1b0-c57f310e173f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:57.983991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-7a3c029c-537c-499e-a1b0-c57f310e173f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:57.991964 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-7a3c029c-537c-499e-a1b0-c57f310e173f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.154517 Jul 29 11:49:57.992523 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 204/422] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:57 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:49:59.013367 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-98b290ba-dd6c-4024-867f-44bee9ab2b1c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:49:59.014009 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-98b290ba-dd6c-4024-867f-44bee9ab2b1c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:49:59.021215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-98b290ba-dd6c-4024-867f-44bee9ab2b1c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:59.021700 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-98b290ba-dd6c-4024-867f-44bee9ab2b1c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:59.022489 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-98b290ba-dd6c-4024-867f-44bee9ab2b1c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:49:59.022924 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-98b290ba-dd6c-4024-867f-44bee9ab2b1c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:49:59.150968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-98b290ba-dd6c-4024-867f-44bee9ab2b1c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:49:59.158996 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-98b290ba-dd6c-4024-867f-44bee9ab2b1c tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.149685 Jul 29 11:49:59.159556 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 219/423] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:49:59 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:00.180094 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6850168e-bee1-4f4d-bf7b-148e93278fe2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:00.180711 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6850168e-bee1-4f4d-bf7b-148e93278fe2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:00.188082 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6850168e-bee1-4f4d-bf7b-148e93278fe2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:00.188569 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6850168e-bee1-4f4d-bf7b-148e93278fe2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:00.189345 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6850168e-bee1-4f4d-bf7b-148e93278fe2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:00.189814 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6850168e-bee1-4f4d-bf7b-148e93278fe2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:00.321724 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6850168e-bee1-4f4d-bf7b-148e93278fe2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:00.329600 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6850168e-bee1-4f4d-bf7b-148e93278fe2 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.153361 Jul 29 11:50:00.330160 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 205/424] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:00 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:01.351712 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-92bbccc5-ae93-485a-a69b-0c37ab5f08c0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:01.352248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-92bbccc5-ae93-485a-a69b-0c37ab5f08c0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:01.359350 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-92bbccc5-ae93-485a-a69b-0c37ab5f08c0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:01.359797 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-92bbccc5-ae93-485a-a69b-0c37ab5f08c0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:01.360560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-92bbccc5-ae93-485a-a69b-0c37ab5f08c0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:01.360989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-92bbccc5-ae93-485a-a69b-0c37ab5f08c0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:01.488597 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-92bbccc5-ae93-485a-a69b-0c37ab5f08c0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:01.496450 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-92bbccc5-ae93-485a-a69b-0c37ab5f08c0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.148693 Jul 29 11:50:01.497012 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 220/425] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:01 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:02.518235 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-cedb2ebe-e40b-45b5-a459-e50b92b991d9 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:02.518763 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-cedb2ebe-e40b-45b5-a459-e50b92b991d9 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:02.525163 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cedb2ebe-e40b-45b5-a459-e50b92b991d9 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:02.525645 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cedb2ebe-e40b-45b5-a459-e50b92b991d9 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:02.526496 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cedb2ebe-e40b-45b5-a459-e50b92b991d9 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:02.526933 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cedb2ebe-e40b-45b5-a459-e50b92b991d9 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:02.653628 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-cedb2ebe-e40b-45b5-a459-e50b92b991d9 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:02.661530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-cedb2ebe-e40b-45b5-a459-e50b92b991d9 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.147863 Jul 29 11:50:02.662080 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 206/426] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:02 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:03.682573 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b94a5a67-5dcb-4b73-8e78-416927bf63e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:03.683186 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b94a5a67-5dcb-4b73-8e78-416927bf63e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:03.690518 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b94a5a67-5dcb-4b73-8e78-416927bf63e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:03.690976 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b94a5a67-5dcb-4b73-8e78-416927bf63e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:03.691800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b94a5a67-5dcb-4b73-8e78-416927bf63e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:03.692240 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b94a5a67-5dcb-4b73-8e78-416927bf63e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:03.821755 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b94a5a67-5dcb-4b73-8e78-416927bf63e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:03.830453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b94a5a67-5dcb-4b73-8e78-416927bf63e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.151723 Jul 29 11:50:03.831058 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 221/427] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:03 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:04.851834 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-523e5724-08c1-49f7-be08-891e60c8034e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:04.852454 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-523e5724-08c1-49f7-be08-891e60c8034e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:04.855173 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=30 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:04.860403 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-523e5724-08c1-49f7-be08-891e60c8034e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:04.860864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-523e5724-08c1-49f7-be08-891e60c8034e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:04.861663 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-523e5724-08c1-49f7-be08-891e60c8034e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:04.862122 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-523e5724-08c1-49f7-be08-891e60c8034e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:04.879089 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:04.994936 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-523e5724-08c1-49f7-be08-891e60c8034e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:05.003130 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-523e5724-08c1-49f7-be08-891e60c8034e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.155119 Jul 29 11:50:05.003697 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 207/428] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:04 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:06.025128 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4f246b48-c245-4133-8d1e-131eaf5fff51 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:06.025886 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-4f246b48-c245-4133-8d1e-131eaf5fff51 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:06.032844 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4f246b48-c245-4133-8d1e-131eaf5fff51 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:06.033268 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4f246b48-c245-4133-8d1e-131eaf5fff51 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:06.034067 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4f246b48-c245-4133-8d1e-131eaf5fff51 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:06.034501 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4f246b48-c245-4133-8d1e-131eaf5fff51 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:06.171946 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4f246b48-c245-4133-8d1e-131eaf5fff51 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:06.180181 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-4f246b48-c245-4133-8d1e-131eaf5fff51 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.159169 Jul 29 11:50:06.180753 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 222/429] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:06 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:07.201383 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c57892ad-aec9-40d9-bf9e-41b2aaba0b10 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:07.202684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-c57892ad-aec9-40d9-bf9e-41b2aaba0b10 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:07.209312 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c57892ad-aec9-40d9-bf9e-41b2aaba0b10 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:07.209795 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c57892ad-aec9-40d9-bf9e-41b2aaba0b10 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:07.210554 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c57892ad-aec9-40d9-bf9e-41b2aaba0b10 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:07.210993 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c57892ad-aec9-40d9-bf9e-41b2aaba0b10 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:07.338579 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-c57892ad-aec9-40d9-bf9e-41b2aaba0b10 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:07.346770 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-c57892ad-aec9-40d9-bf9e-41b2aaba0b10 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.149251 Jul 29 11:50:07.347342 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 208/430] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:07 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:08.368441 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ef8e0b65-5b39-4dcc-a71a-53bad391c59b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:08.368983 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ef8e0b65-5b39-4dcc-a71a-53bad391c59b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:08.375486 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ef8e0b65-5b39-4dcc-a71a-53bad391c59b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:08.375937 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ef8e0b65-5b39-4dcc-a71a-53bad391c59b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:08.376697 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ef8e0b65-5b39-4dcc-a71a-53bad391c59b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:08.377133 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ef8e0b65-5b39-4dcc-a71a-53bad391c59b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:08.504029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ef8e0b65-5b39-4dcc-a71a-53bad391c59b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:08.512112 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ef8e0b65-5b39-4dcc-a71a-53bad391c59b tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.147624 Jul 29 11:50:08.512667 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 223/431] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:08 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:09.301873 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-92b052f1-dc06-4898-a73d-c8e4d06c90b3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:09.302369 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-92b052f1-dc06-4898-a73d-c8e4d06c90b3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:09.308925 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-92b052f1-dc06-4898-a73d-c8e4d06c90b3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:09.309383 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-92b052f1-dc06-4898-a73d-c8e4d06c90b3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:09.310177 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-92b052f1-dc06-4898-a73d-c8e4d06c90b3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:09.310619 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-92b052f1-dc06-4898-a73d-c8e4d06c90b3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:09.334036 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-92b052f1-dc06-4898-a73d-c8e4d06c90b3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44/ips" status: 200 len: 150 microversion: 2.1 time: 0.036033 Jul 29 11:50:09.334594 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 209/432] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Jul 29 11:50:09 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:09.347103 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e2b4679f-b1ab-4d94-a033-255072d87cb2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c076fb95-2396-4068-961f-ac8cd0459596"}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:09.349498 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e2b4679f-b1ab-4d94-a033-255072d87cb2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:09.355600 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e2b4679f-b1ab-4d94-a033-255072d87cb2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:09.356044 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e2b4679f-b1ab-4d94-a033-255072d87cb2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:09.356792 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e2b4679f-b1ab-4d94-a033-255072d87cb2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:09.357223 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e2b4679f-b1ab-4d94-a033-255072d87cb2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:09.438396 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-e2b4679f-b1ab-4d94-a033-255072d87cb2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] HTTP exception thrown: Invalid volume: volume c076fb95-2396-4068-961f-ac8cd0459596 is already attached to instances: 5c8a2d21-648a-4b70-badd-2d7e499f5b90 Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e2b4679f-b1ab-4d94-a033-255072d87cb2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Request method failure captured: Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: POST /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44/os-volume_attachments HTTP/1.1 Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 74 Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48icVbGQpo_IdH8_u62UoQcPfoUo3xwllOW7fjakcJXUphVjQAJzVqE7fI-fsqP3g4NqZjz8YFLyejjO-VLv92lJBWa3RdJ2AtZ841GWsHIbm-PB-ZcSKgDGNNp_FYxiDV5ReNSeL7mFuVa5RErCcpxqZKkcIeuKO_mbw7bKo_jOIw8 Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:50:09.440293 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:50:09.441857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4b9969357142bc8724804eb47e0c48", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:50:09.441857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:50:09.441857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:50:09.441857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:50:09.441857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:50:09.441857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:50:09.441857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:50:09.441857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 1a343996462b462d86fb89b876f4e127 Jul 29 11:50:09.441857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:50:09.441857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Jul 29 11:50:09.441857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {"volumeAttachment": {"volumeId": "c076fb95-2396-4068-961f-ac8cd0459596"}} Jul 29 11:50:09.441857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Invalid volume: volume c076fb95-2396-4068-961f-ac8cd0459596 is already attached to instances: 5c8a2d21-648a-4b70-badd-2d7e499f5b90 Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'server_id': '9fca404e-1bae-45f1-b4c7-0f1363d90a44', 'body': {'volumeAttachment': {'volumeId': 'c076fb95-2396-4068-961f-ac8cd0459596'}}} Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c076fb95-2396-4068-961f-ac8cd0459596 is already attached to instances: 5c8a2d21-648a-4b70-badd-2d7e499f5b90 Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:09.442760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c076fb95-2396-4068-961f-ac8cd0459596 is already attached to instances: 5c8a2d21-648a-4b70-badd-2d7e499f5b90 Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:09.444180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:50:09.445611 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:50:09.445611 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:50:09.445611 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:50:09.445611 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c076fb95-2396-4068-961f-ac8cd0459596 is already attached to instances: 5c8a2d21-648a-4b70-badd-2d7e499f5b90 Jul 29 11:50:09.445611 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:09.445611 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e2b4679f-b1ab-4d94-a033-255072d87cb2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Returning 400 to user: Invalid volume: volume c076fb95-2396-4068-961f-ac8cd0459596 is already attached to instances: 5c8a2d21-648a-4b70-badd-2d7e499f5b90 {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:50:09.445611 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e2b4679f-b1ab-4d94-a033-255072d87cb2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "POST /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098604 Jul 29 11:50:09.445611 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 224/433] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Jul 29 11:50:09 2022] POST /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 11:50:09.450994 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6f5642ab-67d4-4abb-9d84-491a8a386f35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:09.451527 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6f5642ab-67d4-4abb-9d84-491a8a386f35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:09.457705 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6f5642ab-67d4-4abb-9d84-491a8a386f35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:09.458205 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6f5642ab-67d4-4abb-9d84-491a8a386f35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:09.458962 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6f5642ab-67d4-4abb-9d84-491a8a386f35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:09.459397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6f5642ab-67d4-4abb-9d84-491a8a386f35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:09.484242 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6f5642ab-67d4-4abb-9d84-491a8a386f35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Going to try to terminate instance {{(pid=129585) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:50:09.535730 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-dc75882a-c6f1-4468-b8d1-d4ec69e03f46 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:09.536490 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-dc75882a-c6f1-4468-b8d1-d4ec69e03f46 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:09.543454 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dc75882a-c6f1-4468-b8d1-d4ec69e03f46 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:09.543901 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dc75882a-c6f1-4468-b8d1-d4ec69e03f46 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:09.544686 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dc75882a-c6f1-4468-b8d1-d4ec69e03f46 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:09.545845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dc75882a-c6f1-4468-b8d1-d4ec69e03f46 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:09.558342 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6f5642ab-67d4-4abb-9d84-491a8a386f35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 204 len: 0 microversion: 2.1 time: 0.110816 Jul 29 11:50:09.559136 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 210/434] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:50:09 2022] DELETE /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:50:09.568268 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-0408f00e-a4e7-4f8b-9382-9de5494b68b2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:09.569045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-0408f00e-a4e7-4f8b-9382-9de5494b68b2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:09.576116 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0408f00e-a4e7-4f8b-9382-9de5494b68b2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:09.576580 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0408f00e-a4e7-4f8b-9382-9de5494b68b2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:09.577353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0408f00e-a4e7-4f8b-9382-9de5494b68b2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:09.577827 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0408f00e-a4e7-4f8b-9382-9de5494b68b2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:09.743694 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-dc75882a-c6f1-4468-b8d1-d4ec69e03f46 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:09.750465 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-0408f00e-a4e7-4f8b-9382-9de5494b68b2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:09.752137 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-dc75882a-c6f1-4468-b8d1-d4ec69e03f46 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.220958 Jul 29 11:50:09.752714 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 225/435] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:09 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:50:09.757890 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-0408f00e-a4e7-4f8b-9382-9de5494b68b2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1682 microversion: 2.1 time: 0.194371 Jul 29 11:50:09.758446 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 211/436] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:09 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:50:10.774711 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-87ce3436-44af-49aa-bb5d-db10744b8883 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:10.775333 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-87ce3436-44af-49aa-bb5d-db10744b8883 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:10.779323 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-92029e75-9903-488d-84af-10f5a981fa45 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:10.779942 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-92029e75-9903-488d-84af-10f5a981fa45 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:10.781607 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-87ce3436-44af-49aa-bb5d-db10744b8883 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:10.782058 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-87ce3436-44af-49aa-bb5d-db10744b8883 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:10.782828 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-87ce3436-44af-49aa-bb5d-db10744b8883 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:10.783269 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-87ce3436-44af-49aa-bb5d-db10744b8883 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:10.786422 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-92029e75-9903-488d-84af-10f5a981fa45 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:10.786878 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-92029e75-9903-488d-84af-10f5a981fa45 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:10.787646 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-92029e75-9903-488d-84af-10f5a981fa45 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:10.788079 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-92029e75-9903-488d-84af-10f5a981fa45 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:10.977610 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-92029e75-9903-488d-84af-10f5a981fa45 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:10.981253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-87ce3436-44af-49aa-bb5d-db10744b8883 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:10.985292 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-92029e75-9903-488d-84af-10f5a981fa45 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1682 microversion: 2.1 time: 0.209785 Jul 29 11:50:10.986116 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 212/437] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:10 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1682 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:50:10.989534 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-87ce3436-44af-49aa-bb5d-db10744b8883 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.218742 Jul 29 11:50:10.990089 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 226/438] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:10 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:12.007040 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8002b4a9-a4c8-45f4-bb3b-b60cc704fba4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:12.007667 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8002b4a9-a4c8-45f4-bb3b-b60cc704fba4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:12.012866 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-0a08ad1f-8a26-4cb9-bb00-270ddd30cafb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:12.013536 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-0a08ad1f-8a26-4cb9-bb00-270ddd30cafb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:12.015073 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8002b4a9-a4c8-45f4-bb3b-b60cc704fba4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:12.015605 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8002b4a9-a4c8-45f4-bb3b-b60cc704fba4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:12.016477 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8002b4a9-a4c8-45f4-bb3b-b60cc704fba4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:12.016971 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8002b4a9-a4c8-45f4-bb3b-b60cc704fba4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:12.019947 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0a08ad1f-8a26-4cb9-bb00-270ddd30cafb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:12.020392 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0a08ad1f-8a26-4cb9-bb00-270ddd30cafb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:12.022379 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0a08ad1f-8a26-4cb9-bb00-270ddd30cafb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:12.022379 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0a08ad1f-8a26-4cb9-bb00-270ddd30cafb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:12.300461 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-0a08ad1f-8a26-4cb9-bb00-270ddd30cafb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:12.304577 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-8002b4a9-a4c8-45f4-bb3b-b60cc704fba4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:12.310138 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-0a08ad1f-8a26-4cb9-bb00-270ddd30cafb tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.302735 Jul 29 11:50:12.313930 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8002b4a9-a4c8-45f4-bb3b-b60cc704fba4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 200 len: 1682 microversion: 2.1 time: 0.310812 Jul 29 11:50:12.319450 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 213/439] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:12 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 1682 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:12.319600 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 227/440] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:12 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:50:12.687948 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-0a1413d1-0eb6-401a-b4c2-57440c2b359e req-c3f092a2-c046-46dd-bdde-cdfc294067d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fca404e-1bae-45f1-b4c7-0f1363d90a44", "name": "network-vif-deleted", "tag": "4320296e-8fd1-4e24-b644-cad52e9c4572"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:12.697751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-0a1413d1-0eb6-401a-b4c2-57440c2b359e req-c3f092a2-c046-46dd-bdde-cdfc294067d1 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:12.698448 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-0a1413d1-0eb6-401a-b4c2-57440c2b359e req-c3f092a2-c046-46dd-bdde-cdfc294067d1 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:12.710871 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-0a1413d1-0eb6-401a-b4c2-57440c2b359e req-c3f092a2-c046-46dd-bdde-cdfc294067d1 service nova] Creating event network-vif-deleted:4320296e-8fd1-4e24-b644-cad52e9c4572 for instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 on hv-cinder-83754 Jul 29 11:50:12.716597 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-0a1413d1-0eb6-401a-b4c2-57440c2b359e req-c3f092a2-c046-46dd-bdde-cdfc294067d1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032238 Jul 29 11:50:12.717381 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 214/441] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:13.333148 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d2087113-ce18-4133-8b06-ff65b806fa4e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:13.333700 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d2087113-ce18-4133-8b06-ff65b806fa4e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:13.336627 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8f80af21-1d5a-41cc-981d-d9a1cae7db0b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:13.337461 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8f80af21-1d5a-41cc-981d-d9a1cae7db0b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:13.341329 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d2087113-ce18-4133-8b06-ff65b806fa4e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:13.342718 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d2087113-ce18-4133-8b06-ff65b806fa4e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:13.344006 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d2087113-ce18-4133-8b06-ff65b806fa4e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:13.344546 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d2087113-ce18-4133-8b06-ff65b806fa4e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:13.346064 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8f80af21-1d5a-41cc-981d-d9a1cae7db0b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:13.346717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8f80af21-1d5a-41cc-981d-d9a1cae7db0b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:13.347673 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8f80af21-1d5a-41cc-981d-d9a1cae7db0b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:13.348879 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8f80af21-1d5a-41cc-981d-d9a1cae7db0b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:13.363955 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-8f80af21-1d5a-41cc-981d-d9a1cae7db0b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] HTTP exception thrown: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8f80af21-1d5a-41cc-981d-d9a1cae7db0b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Request method failure captured: Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 HTTP/1.1 Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48icVbGQpo_IdH8_u62UoQcPfoUo3xwllOW7fjakcJXUphVjQAJzVqE7fI-fsqP3g4NqZjz8YFLyejjO-VLv92lJBWa3RdJ2AtZ841GWsHIbm-PB-ZcSKgDGNNp_FYxiDV5ReNSeL7mFuVa5RErCcpxqZKkcIeuKO_mbw7bKo_jOIw8 Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:50:13.365950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:50:13.367482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4b9969357142bc8724804eb47e0c48", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:50:13.367482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:50:13.367482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:50:13.367482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:50:13.367482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:50:13.367482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:50:13.367482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:50:13.367482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 1a343996462b462d86fb89b876f4e127 Jul 29 11:50:13.367482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:50:13.367482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:50:13.367482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. Jul 29 11:50:13.367482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': '9fca404e-1bae-45f1-b4c7-0f1363d90a44'} Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:50:13.368356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. Jul 29 11:50:13.369806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:50:13.372389 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8f80af21-1d5a-41cc-981d-d9a1cae7db0b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Returning 404 to user: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:50:13.373570 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8f80af21-1d5a-41cc-981d-d9a1cae7db0b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 404 len: 111 microversion: 2.1 time: 0.041556 Jul 29 11:50:13.375092 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 215/442] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:13 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 11:50:13.385149 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-05a68d1a-e783-4ec7-9397-2cd9219f9295 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '.version_select at 0x7f68fa1864c0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:13.412228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-05a68d1a-e783-4ec7-9397-2cd9219f9295 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-558765569" status: 202 len: 0 microversion: 2.1 time: 0.032686 Jul 29 11:50:13.413645 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 216/443] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Jul 29 11:50:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-558765569 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:50:13.500185 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d2087113-ce18-4133-8b06-ff65b806fa4e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:13.509836 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d2087113-ce18-4133-8b06-ff65b806fa4e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.180842 Jul 29 11:50:13.511267 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 228/444] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:13 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:13.522564 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-30322f8f-3aef-4a41-bcf9-29443e74cd62 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:13.523579 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-30322f8f-3aef-4a41-bcf9-29443e74cd62 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:13.531261 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-30322f8f-3aef-4a41-bcf9-29443e74cd62 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:13.532084 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-30322f8f-3aef-4a41-bcf9-29443e74cd62 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:13.533247 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-30322f8f-3aef-4a41-bcf9-29443e74cd62 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:13.534603 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-30322f8f-3aef-4a41-bcf9-29443e74cd62 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:13.649670 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.objects.instance [None req-30322f8f-3aef-4a41-bcf9-29443e74cd62 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lazy-loading 'services' on Instance uuid 839a7b01-ae71-4df9-8f76-2842e0c61798 {{(pid=129585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:50:13.743902 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-30322f8f-3aef-4a41-bcf9-29443e74cd62 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "DELETE /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798/os-volume_attachments/3004286e-cb71-467e-8520-db7d4d12bea9" status: 202 len: 0 microversion: 2.1 time: 0.225204 Jul 29 11:50:13.744652 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 217/445] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Jul 29 11:50:13 2022] DELETE /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798/os-volume_attachments/3004286e-cb71-467e-8520-db7d4d12bea9 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:50:14.224089 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b26728f9-6df1-437b-a8fb-1ec5d9f9973a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:14.224770 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b26728f9-6df1-437b-a8fb-1ec5d9f9973a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:14.231142 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b26728f9-6df1-437b-a8fb-1ec5d9f9973a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:14.231583 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b26728f9-6df1-437b-a8fb-1ec5d9f9973a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:14.232879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b26728f9-6df1-437b-a8fb-1ec5d9f9973a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:14.233306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b26728f9-6df1-437b-a8fb-1ec5d9f9973a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:14.361934 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-b26728f9-6df1-437b-a8fb-1ec5d9f9973a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lazy-loading 'services' on Instance uuid 5c8a2d21-648a-4b70-badd-2d7e499f5b90 {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:50:14.484275 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b26728f9-6df1-437b-a8fb-1ec5d9f9973a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90/os-volume_attachments/c076fb95-2396-4068-961f-ac8cd0459596" status: 202 len: 0 microversion: 2.1 time: 0.264055 Jul 29 11:50:14.484859 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 229/446] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Jul 29 11:50:14 2022] DELETE /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90/os-volume_attachments/c076fb95-2396-4068-961f-ac8cd0459596 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:50:14.494844 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a38b7786-1bcb-47ae-beed-46ccbed5a459 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:14.508087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a38b7786-1bcb-47ae-beed-46ccbed5a459 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:14.516957 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a38b7786-1bcb-47ae-beed-46ccbed5a459 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:14.517427 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a38b7786-1bcb-47ae-beed-46ccbed5a459 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:14.518233 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a38b7786-1bcb-47ae-beed-46ccbed5a459 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:14.518672 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a38b7786-1bcb-47ae-beed-46ccbed5a459 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:14.532669 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3604a73a-fa57-4fc0-aa6a-548482ac12f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:14.533366 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3604a73a-fa57-4fc0-aa6a-548482ac12f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:14.540248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3604a73a-fa57-4fc0-aa6a-548482ac12f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:14.540695 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3604a73a-fa57-4fc0-aa6a-548482ac12f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:14.541678 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3604a73a-fa57-4fc0-aa6a-548482ac12f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:14.542118 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3604a73a-fa57-4fc0-aa6a-548482ac12f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:14.549715 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a38b7786-1bcb-47ae-beed-46ccbed5a459 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059518 Jul 29 11:50:14.550780 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 218/447] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:50:14 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:14.690512 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3604a73a-fa57-4fc0-aa6a-548482ac12f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:14.698496 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3604a73a-fa57-4fc0-aa6a-548482ac12f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.170132 Jul 29 11:50:14.699055 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 230/448] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:14 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:50:14.884854 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-68367253-f91b-4e99-8b56-d98d73748ee1 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:14.885360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-68367253-f91b-4e99-8b56-d98d73748ee1 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:14.892351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-68367253-f91b-4e99-8b56-d98d73748ee1 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:14.892805 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-68367253-f91b-4e99-8b56-d98d73748ee1 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:14.893612 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-68367253-f91b-4e99-8b56-d98d73748ee1 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:14.894056 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-68367253-f91b-4e99-8b56-d98d73748ee1 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:14.921592 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-68367253-f91b-4e99-8b56-d98d73748ee1 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Going to try to terminate instance {{(pid=129585) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:50:15.004368 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-68367253-f91b-4e99-8b56-d98d73748ee1 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "DELETE /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 204 len: 0 microversion: 2.1 time: 0.123077 Jul 29 11:50:15.005089 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 219/449] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:50:14 2022] DELETE /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:50:15.014107 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-852e13b3-4200-450a-9eee-f25e8752ef32 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:15.014712 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-852e13b3-4200-450a-9eee-f25e8752ef32 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:15.021597 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-852e13b3-4200-450a-9eee-f25e8752ef32 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:15.022084 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-852e13b3-4200-450a-9eee-f25e8752ef32 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:15.022879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-852e13b3-4200-450a-9eee-f25e8752ef32 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:15.023432 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-852e13b3-4200-450a-9eee-f25e8752ef32 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:15.026271 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:15.158110 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-852e13b3-4200-450a-9eee-f25e8752ef32 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:15.165671 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-852e13b3-4200-450a-9eee-f25e8752ef32 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 200 len: 1515 microversion: 2.1 time: 0.156187 Jul 29 11:50:15.166235 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 231/450] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:15 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:50:15.563508 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-dcf21f4d-2bb9-4e4a-9580-984e8700e21e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:15.565723 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-dcf21f4d-2bb9-4e4a-9580-984e8700e21e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:15.572162 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-dcf21f4d-2bb9-4e4a-9580-984e8700e21e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:15.572608 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-dcf21f4d-2bb9-4e4a-9580-984e8700e21e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:15.573361 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-dcf21f4d-2bb9-4e4a-9580-984e8700e21e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:15.573824 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-dcf21f4d-2bb9-4e4a-9580-984e8700e21e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:15.604537 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-dcf21f4d-2bb9-4e4a-9580-984e8700e21e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045953 Jul 29 11:50:15.605099 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 220/451] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:50:15 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:15.720353 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-cf976b19-c6fc-4f7e-af12-b63d97e5a694 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:15.720993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-cf976b19-c6fc-4f7e-af12-b63d97e5a694 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:15.727471 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cf976b19-c6fc-4f7e-af12-b63d97e5a694 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:15.727931 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cf976b19-c6fc-4f7e-af12-b63d97e5a694 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:15.728697 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cf976b19-c6fc-4f7e-af12-b63d97e5a694 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:15.729138 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cf976b19-c6fc-4f7e-af12-b63d97e5a694 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:15.855215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-cf976b19-c6fc-4f7e-af12-b63d97e5a694 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:15.863708 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-cf976b19-c6fc-4f7e-af12-b63d97e5a694 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.147574 Jul 29 11:50:15.864276 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 232/452] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:15 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:16.187037 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-bfb35741-ded8-43a7-87ad-3a4dd140236d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:16.187685 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-bfb35741-ded8-43a7-87ad-3a4dd140236d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:16.193750 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bfb35741-ded8-43a7-87ad-3a4dd140236d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:16.194207 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bfb35741-ded8-43a7-87ad-3a4dd140236d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:16.194972 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bfb35741-ded8-43a7-87ad-3a4dd140236d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:16.195412 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bfb35741-ded8-43a7-87ad-3a4dd140236d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:16.324970 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-bfb35741-ded8-43a7-87ad-3a4dd140236d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:16.332527 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-bfb35741-ded8-43a7-87ad-3a4dd140236d tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 200 len: 1515 microversion: 2.1 time: 0.149348 Jul 29 11:50:16.333095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 221/453] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:16 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:16.617456 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-dd1c5d5f-4414-4a9e-8d6e-d0e6ad15f1c0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:16.619836 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-dd1c5d5f-4414-4a9e-8d6e-d0e6ad15f1c0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:16.626007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dd1c5d5f-4414-4a9e-8d6e-d0e6ad15f1c0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:16.626455 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dd1c5d5f-4414-4a9e-8d6e-d0e6ad15f1c0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:16.627219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dd1c5d5f-4414-4a9e-8d6e-d0e6ad15f1c0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:16.627654 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dd1c5d5f-4414-4a9e-8d6e-d0e6ad15f1c0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:16.659607 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-dd1c5d5f-4414-4a9e-8d6e-d0e6ad15f1c0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046142 Jul 29 11:50:16.660197 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 233/454] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:50:16 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:16.884766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9214a17b-4997-4343-b4d8-02607fb573f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:16.885341 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9214a17b-4997-4343-b4d8-02607fb573f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:16.892853 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9214a17b-4997-4343-b4d8-02607fb573f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:16.893310 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9214a17b-4997-4343-b4d8-02607fb573f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:16.894117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9214a17b-4997-4343-b4d8-02607fb573f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:16.894558 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9214a17b-4997-4343-b4d8-02607fb573f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:17.028841 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9214a17b-4997-4343-b4d8-02607fb573f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:17.031494 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:17.039566 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9214a17b-4997-4343-b4d8-02607fb573f4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.158462 Jul 29 11:50:17.040523 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 222/455] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:16 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:17.353796 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9b45769d-cc86-4d53-9343-a50768f88273 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:17.354410 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-9b45769d-cc86-4d53-9343-a50768f88273 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:17.361526 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9b45769d-cc86-4d53-9343-a50768f88273 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:17.361980 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9b45769d-cc86-4d53-9343-a50768f88273 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:17.362742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9b45769d-cc86-4d53-9343-a50768f88273 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:17.363179 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9b45769d-cc86-4d53-9343-a50768f88273 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:17.489747 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-9b45769d-cc86-4d53-9343-a50768f88273 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:17.497245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-9b45769d-cc86-4d53-9343-a50768f88273 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 200 len: 1515 microversion: 2.1 time: 0.147223 Jul 29 11:50:17.498394 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 234/456] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:17 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:17.670946 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-92330798-49ce-4d64-84d2-3d6acfe3742d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:17.673164 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-92330798-49ce-4d64-84d2-3d6acfe3742d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:17.680790 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-92330798-49ce-4d64-84d2-3d6acfe3742d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:17.681245 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-92330798-49ce-4d64-84d2-3d6acfe3742d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:17.682045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-92330798-49ce-4d64-84d2-3d6acfe3742d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:17.682483 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-92330798-49ce-4d64-84d2-3d6acfe3742d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:17.711691 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-92330798-49ce-4d64-84d2-3d6acfe3742d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044755 Jul 29 11:50:17.712250 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 223/457] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:50:17 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 11:50:17.772215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-478a61db-e8b0-4e55-9565-b9af2a66850d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:17.772707 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-478a61db-e8b0-4e55-9565-b9af2a66850d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:17.778572 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-478a61db-e8b0-4e55-9565-b9af2a66850d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:17.779039 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-478a61db-e8b0-4e55-9565-b9af2a66850d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:17.779852 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-478a61db-e8b0-4e55-9565-b9af2a66850d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:17.780284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-478a61db-e8b0-4e55-9565-b9af2a66850d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:17.803695 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-478a61db-e8b0-4e55-9565-b9af2a66850d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Going to try to terminate instance {{(pid=129584) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:50:17.883522 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-478a61db-e8b0-4e55-9565-b9af2a66850d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 204 len: 0 microversion: 2.1 time: 0.114749 Jul 29 11:50:17.884095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 235/458] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:50:17 2022] DELETE /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:50:17.892474 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8dbf5536-d946-4c9d-9f63-13b5ad78f05f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:17.893087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8dbf5536-d946-4c9d-9f63-13b5ad78f05f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:17.899679 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8dbf5536-d946-4c9d-9f63-13b5ad78f05f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:17.900130 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8dbf5536-d946-4c9d-9f63-13b5ad78f05f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:17.900888 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8dbf5536-d946-4c9d-9f63-13b5ad78f05f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:17.901326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8dbf5536-d946-4c9d-9f63-13b5ad78f05f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:18.062439 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f813c721-1c7f-4867-8533-c606551041df tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:18.063262 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f813c721-1c7f-4867-8533-c606551041df tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:18.064755 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-8dbf5536-d946-4c9d-9f63-13b5ad78f05f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:18.069442 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f813c721-1c7f-4867-8533-c606551041df tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:18.069920 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f813c721-1c7f-4867-8533-c606551041df tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:18.070705 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f813c721-1c7f-4867-8533-c606551041df tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:18.071147 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f813c721-1c7f-4867-8533-c606551041df tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:18.072324 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8dbf5536-d946-4c9d-9f63-13b5ad78f05f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1681 microversion: 2.1 time: 0.183769 Jul 29 11:50:18.072894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 224/459] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:17 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:18.201115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f813c721-1c7f-4867-8533-c606551041df tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:18.209270 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f813c721-1c7f-4867-8533-c606551041df tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.152019 Jul 29 11:50:18.209877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 236/460] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:18 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:50:18.518834 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a72a3e7f-9d5b-42d4-9a90-f695a1b09ea5 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:18.519450 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a72a3e7f-9d5b-42d4-9a90-f695a1b09ea5 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:18.525529 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a72a3e7f-9d5b-42d4-9a90-f695a1b09ea5 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:18.525983 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a72a3e7f-9d5b-42d4-9a90-f695a1b09ea5 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:18.526743 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a72a3e7f-9d5b-42d4-9a90-f695a1b09ea5 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:18.527179 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a72a3e7f-9d5b-42d4-9a90-f695a1b09ea5 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:18.655960 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a72a3e7f-9d5b-42d4-9a90-f695a1b09ea5 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:18.663352 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a72a3e7f-9d5b-42d4-9a90-f695a1b09ea5 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 200 len: 1515 microversion: 2.1 time: 0.148431 Jul 29 11:50:18.663910 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 225/461] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:18 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:19.094262 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-fc42d06f-65a4-4bb5-a46f-583f4c479e94 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:19.094914 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-fc42d06f-65a4-4bb5-a46f-583f4c479e94 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:19.101361 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fc42d06f-65a4-4bb5-a46f-583f4c479e94 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:19.101845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fc42d06f-65a4-4bb5-a46f-583f4c479e94 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:19.102612 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fc42d06f-65a4-4bb5-a46f-583f4c479e94 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:19.103052 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fc42d06f-65a4-4bb5-a46f-583f4c479e94 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:19.230833 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6178273b-bc3a-4c08-8989-d31e4eae4683 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:19.231877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-fc42d06f-65a4-4bb5-a46f-583f4c479e94 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:19.232012 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6178273b-bc3a-4c08-8989-d31e4eae4683 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:19.239206 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6178273b-bc3a-4c08-8989-d31e4eae4683 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:19.239665 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6178273b-bc3a-4c08-8989-d31e4eae4683 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:19.240211 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-fc42d06f-65a4-4bb5-a46f-583f4c479e94 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1681 microversion: 2.1 time: 0.150442 Jul 29 11:50:19.240438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6178273b-bc3a-4c08-8989-d31e4eae4683 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:19.240774 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 237/462] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:19 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:19.240884 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6178273b-bc3a-4c08-8989-d31e4eae4683 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:19.372119 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6178273b-bc3a-4c08-8989-d31e4eae4683 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:19.381030 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6178273b-bc3a-4c08-8989-d31e4eae4683 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.153955 Jul 29 11:50:19.381846 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 226/463] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:19 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:50:19.684267 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4f0df3e6-5fb3-495d-97ea-4c685366606e tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:19.684881 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-4f0df3e6-5fb3-495d-97ea-4c685366606e tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:19.693065 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4f0df3e6-5fb3-495d-97ea-4c685366606e tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:19.693629 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4f0df3e6-5fb3-495d-97ea-4c685366606e tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:19.695178 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4f0df3e6-5fb3-495d-97ea-4c685366606e tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:19.695620 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4f0df3e6-5fb3-495d-97ea-4c685366606e tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:19.782322 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4f0df3e6-5fb3-495d-97ea-4c685366606e tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:19.789871 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-4f0df3e6-5fb3-495d-97ea-4c685366606e tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 200 len: 1473 microversion: 2.1 time: 0.109457 Jul 29 11:50:19.790449 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 238/464] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:19 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 1473 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:19.817310 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-78f2f799-9f60-4018-9955-3d3bbfb927d9 req-1a6a9d9f-9f1a-4bfb-94ae-0d23ca210845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839a7b01-ae71-4df9-8f76-2842e0c61798", "name": "network-vif-deleted", "tag": "2aae6285-c16d-4c67-a214-8f39a536fcca"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:19.827750 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-78f2f799-9f60-4018-9955-3d3bbfb927d9 req-1a6a9d9f-9f1a-4bfb-94ae-0d23ca210845 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:19.828187 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-78f2f799-9f60-4018-9955-3d3bbfb927d9 req-1a6a9d9f-9f1a-4bfb-94ae-0d23ca210845 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:19.838772 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-78f2f799-9f60-4018-9955-3d3bbfb927d9 req-1a6a9d9f-9f1a-4bfb-94ae-0d23ca210845 service nova] Creating event network-vif-deleted:2aae6285-c16d-4c67-a214-8f39a536fcca for instance 839a7b01-ae71-4df9-8f76-2842e0c61798 on hv-cinder-83754 Jul 29 11:50:19.843536 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-78f2f799-9f60-4018-9955-3d3bbfb927d9 req-1a6a9d9f-9f1a-4bfb-94ae-0d23ca210845 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029880 Jul 29 11:50:19.844100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 227/465] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:20.261703 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-99dcbdf2-32e7-419c-b88a-eef7a895aefd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:20.262333 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-99dcbdf2-32e7-419c-b88a-eef7a895aefd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:20.269349 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-99dcbdf2-32e7-419c-b88a-eef7a895aefd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:20.269838 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-99dcbdf2-32e7-419c-b88a-eef7a895aefd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:20.270607 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-99dcbdf2-32e7-419c-b88a-eef7a895aefd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:20.271043 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-99dcbdf2-32e7-419c-b88a-eef7a895aefd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:20.403755 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ab1a4a95-a0c0-4ab4-b8d4-0dd869c8c220 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:20.405409 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ab1a4a95-a0c0-4ab4-b8d4-0dd869c8c220 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:20.412009 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ab1a4a95-a0c0-4ab4-b8d4-0dd869c8c220 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:20.412536 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ab1a4a95-a0c0-4ab4-b8d4-0dd869c8c220 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:20.413398 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ab1a4a95-a0c0-4ab4-b8d4-0dd869c8c220 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:20.413959 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ab1a4a95-a0c0-4ab4-b8d4-0dd869c8c220 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:20.519290 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-99dcbdf2-32e7-419c-b88a-eef7a895aefd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:20.526989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-99dcbdf2-32e7-419c-b88a-eef7a895aefd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1681 microversion: 2.1 time: 0.269420 Jul 29 11:50:20.527662 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 239/466] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:20 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1681 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:20.666351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ab1a4a95-a0c0-4ab4-b8d4-0dd869c8c220 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:20.681732 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ab1a4a95-a0c0-4ab4-b8d4-0dd869c8c220 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1735 microversion: 2.1 time: 0.282386 Jul 29 11:50:20.682489 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 228/467] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:20 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1735 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:50:20.811423 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f19a395e-4eb5-41bd-9592-3ab2e5f435dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:20.811951 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f19a395e-4eb5-41bd-9592-3ab2e5f435dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:20.818005 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f19a395e-4eb5-41bd-9592-3ab2e5f435dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:20.818454 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f19a395e-4eb5-41bd-9592-3ab2e5f435dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:20.819249 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f19a395e-4eb5-41bd-9592-3ab2e5f435dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:20.819698 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f19a395e-4eb5-41bd-9592-3ab2e5f435dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:20.850793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f19a395e-4eb5-41bd-9592-3ab2e5f435dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:20.851248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f19a395e-4eb5-41bd-9592-3ab2e5f435dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:20.851707 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-f19a395e-4eb5-41bd-9592-3ab2e5f435dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lazy-loading 'fault' on Instance uuid 839a7b01-ae71-4df9-8f76-2842e0c61798 {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:50:20.915165 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f19a395e-4eb5-41bd-9592-3ab2e5f435dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22bac56ed1472a9b2e7b6943736333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1658d63aa1b54aa5a36754e83179e317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:20.923940 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f19a395e-4eb5-41bd-9592-3ab2e5f435dd tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 200 len: 1309 microversion: 2.1 time: 0.116995 Jul 29 11:50:20.933350 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 240/468] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:20 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 1309 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:21.550574 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-d57855fd-b35b-4d7b-baad-00e0ee4f1643 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:21.551265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-d57855fd-b35b-4d7b-baad-00e0ee4f1643 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:21.559947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d57855fd-b35b-4d7b-baad-00e0ee4f1643 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:21.561198 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d57855fd-b35b-4d7b-baad-00e0ee4f1643 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:21.562419 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d57855fd-b35b-4d7b-baad-00e0ee4f1643 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:21.563504 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d57855fd-b35b-4d7b-baad-00e0ee4f1643 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:21.600739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d57855fd-b35b-4d7b-baad-00e0ee4f1643 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:21.601195 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d57855fd-b35b-4d7b-baad-00e0ee4f1643 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:21.601916 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.objects.instance [None req-d57855fd-b35b-4d7b-baad-00e0ee4f1643 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lazy-loading 'fault' on Instance uuid 5c8a2d21-648a-4b70-badd-2d7e499f5b90 {{(pid=129585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:50:21.658244 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-d57855fd-b35b-4d7b-baad-00e0ee4f1643 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:21.669048 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-d57855fd-b35b-4d7b-baad-00e0ee4f1643 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 200 len: 1331 microversion: 2.1 time: 0.124690 Jul 29 11:50:21.669799 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 229/469] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:21 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 1331 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:21.707784 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-56c239ec-e175-4cee-93f4-a8dfe66deee1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:21.708606 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-56c239ec-e175-4cee-93f4-a8dfe66deee1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:21.715221 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-56c239ec-e175-4cee-93f4-a8dfe66deee1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:21.715679 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-56c239ec-e175-4cee-93f4-a8dfe66deee1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:21.717245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-56c239ec-e175-4cee-93f4-a8dfe66deee1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:21.718312 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-56c239ec-e175-4cee-93f4-a8dfe66deee1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:21.861769 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-4b943d23-dbc6-4416-8c2b-eade5467b3b6 req-185e24e3-1b31-4ec2-8575-a27840c9ae9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8a2d21-648a-4b70-badd-2d7e499f5b90", "name": "network-vif-deleted", "tag": "37549cbf-4d66-48e6-b4f4-c12905ec4351"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:21.866974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-56c239ec-e175-4cee-93f4-a8dfe66deee1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:21.871773 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-4b943d23-dbc6-4416-8c2b-eade5467b3b6 req-185e24e3-1b31-4ec2-8575-a27840c9ae9b service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:21.872215 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-4b943d23-dbc6-4416-8c2b-eade5467b3b6 req-185e24e3-1b31-4ec2-8575-a27840c9ae9b service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:21.875650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-56c239ec-e175-4cee-93f4-a8dfe66deee1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1715 microversion: 2.1 time: 0.172022 Jul 29 11:50:21.884243 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-4b943d23-dbc6-4416-8c2b-eade5467b3b6 req-185e24e3-1b31-4ec2-8575-a27840c9ae9b service nova] Creating event network-vif-deleted:37549cbf-4d66-48e6-b4f4-c12905ec4351 for instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 on hv-cinder-83754 Jul 29 11:50:21.889681 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 241/470] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:21 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1715 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:21.900499 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-4b943d23-dbc6-4416-8c2b-eade5467b3b6 req-185e24e3-1b31-4ec2-8575-a27840c9ae9b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042369 Jul 29 11:50:21.901309 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 230/471] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:21.947925 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-10c92f82-bea6-4a96-86bf-437d003a6f98 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:21.948553 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-10c92f82-bea6-4a96-86bf-437d003a6f98 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] [instance: 839a7b01-ae71-4df9-8f76-2842e0c61798] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:21.948699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5543a4d3-772c-46aa-854f-5b31d4af36e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:21.949515 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-5543a4d3-772c-46aa-854f-5b31d4af36e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:21.955478 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-10c92f82-bea6-4a96-86bf-437d003a6f98 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:21.955933 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-10c92f82-bea6-4a96-86bf-437d003a6f98 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:21.956706 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-10c92f82-bea6-4a96-86bf-437d003a6f98 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:21.957143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-10c92f82-bea6-4a96-86bf-437d003a6f98 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:21.957253 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5543a4d3-772c-46aa-854f-5b31d4af36e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:21.957676 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5543a4d3-772c-46aa-854f-5b31d4af36e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:21.958459 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5543a4d3-772c-46aa-854f-5b31d4af36e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:21.958906 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5543a4d3-772c-46aa-854f-5b31d4af36e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:21.972163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-10c92f82-bea6-4a96-86bf-437d003a6f98 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] HTTP exception thrown: Instance 839a7b01-ae71-4df9-8f76-2842e0c61798 could not be found. Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-10c92f82-bea6-4a96-86bf-437d003a6f98 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Request method failure captured: Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 HTTP/1.1 Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48jp1w-Ot_13ELJmVkWyuwS8QY9NYZ_-lWO7kdtaPFzD7xuNHiv5UQJdybPL5_uTSYP3FJ5AfobmEt_WZJcEv_4cC0c_Ugztzus4dBNgWTCNY1u20QO9XpWSCzRy0xibEJbvL0KiS6-NovWi8deyVgmBHex8keYqqvxEXNxl9NPFo-8 Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 1658d63aa1b54aa5a36754e83179e317 Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1487326111 Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:50:21.973863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:50:21.976762 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1658d63aa1b54aa5a36754e83179e317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1658d63aa1b54aa5a36754e83179e317", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1658d63aa1b54aa5a36754e83179e317"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1658d63aa1b54aa5a36754e83179e317"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:50:21.976762 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-VolumesSnapshotTestJSON-1487326111 Jul 29 11:50:21.976762 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 1658d63aa1b54aa5a36754e83179e317 Jul 29 11:50:21.976762 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1487326111 Jul 29 11:50:21.976762 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-VolumesSnapshotTestJSON-1487326111-project Jul 29 11:50:21.976762 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:50:21.976762 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:50:21.976762 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 0c22bac56ed1472a9b2e7b6943736333 Jul 29 11:50:21.976762 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-VolumesSnapshotTestJSON-1487326111-project Jul 29 11:50:21.976762 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:50:21.976762 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance 839a7b01-ae71-4df9-8f76-2842e0c61798 could not be found. Jul 29 11:50:21.976762 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '839a7b01-ae71-4df9-8f76-2842e0c61798'} Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 839a7b01-ae71-4df9-8f76-2842e0c61798 could not be found. Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:50:21.978473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 839a7b01-ae71-4df9-8f76-2842e0c61798 could not be found. Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 839a7b01-ae71-4df9-8f76-2842e0c61798 could not be found. Jul 29 11:50:21.981644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:21.983869 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-10c92f82-bea6-4a96-86bf-437d003a6f98 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] Returning 404 to user: Instance 839a7b01-ae71-4df9-8f76-2842e0c61798 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:50:21.983869 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-10c92f82-bea6-4a96-86bf-437d003a6f98 tempest-VolumesSnapshotTestJSON-1487326111 tempest-VolumesSnapshotTestJSON-1487326111-project] 10.222.0.60 "GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798" status: 404 len: 111 microversion: 2.1 time: 0.032903 Jul 29 11:50:21.983869 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 242/472] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:21 2022] GET /compute/v2.1/servers/839a7b01-ae71-4df9-8f76-2842e0c61798 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:50:22.065499 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-5543a4d3-772c-46aa-854f-5b31d4af36e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] HTTP exception thrown: Cannot 'detach_volume' instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a while it is in vm_state rescued Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5543a4d3-772c-46aa-854f-5b31d4af36e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Request method failure captured: Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: DELETE /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/os-volume_attachments/5c877b70-645e-404e-92b9-880786582e41 HTTP/1.1 Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48icWNF5VduBTIvjMx74oGekPjDM_WyPKfDFEqTnYbP9pmMYJ3iVEIhDcbFTI1aIEBtbuMVZ512qIJ9lmpywo_t0j8JU4KEV9fFpkjZDe9V6y8DrRt8ODhPkRG0qurIOC8MLkMcQJ5L6wWkf-02BMuHwG4Gsjsp_xiI86N4-AN7FChY Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 106664c99e9c4a0d9a9c9c05e08a3d7f Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1574150610 Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:50:22.067114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:50:22.068685 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/106664c99e9c4a0d9a9c9c05e08a3d7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_106664c99e9c4a0d9a9c9c05e08a3d7f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/106664c99e9c4a0d9a9c9c05e08a3d7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/106664c99e9c4a0d9a9c9c05e08a3d7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:50:22.068685 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1574150610 Jul 29 11:50:22.068685 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 106664c99e9c4a0d9a9c9c05e08a3d7f Jul 29 11:50:22.068685 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1574150610 Jul 29 11:50:22.068685 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-ServerRescueNegativeTestJSON-1574150610-project Jul 29 11:50:22.068685 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:50:22.068685 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:50:22.068685 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 9d341bba8dda445ca4eac6d52aa9f80c Jul 29 11:50:22.068685 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1574150610-project Jul 29 11:50:22.068685 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:50:22.068685 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Cannot 'detach_volume' instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a while it is in vm_state rescued Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'server_id': '51b4f838-c329-43d2-8448-82ad1ee8ad2a', 'id': '5c877b70-645e-404e-92b9-880786582e41'} Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:50:22.072969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:50:22.074351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 29 11:50:22.074351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 29 11:50:22.074351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 29 11:50:22.074351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 29 11:50:22.074351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a while it is in vm_state rescued Jul 29 11:50:22.074351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:50:22.074351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:50:22.074351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:50:22.074351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:22.074351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:50:22.074351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:50:22.074351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:50:22.074351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:50:22.074351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a while it is in vm_state rescued Jul 29 11:50:22.074351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:50:22.074351 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5543a4d3-772c-46aa-854f-5b31d4af36e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Returning 409 to user: Cannot 'detach_volume' instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a while it is in vm_state rescued {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:50:22.075429 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-5543a4d3-772c-46aa-854f-5b31d4af36e4 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "DELETE /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/os-volume_attachments/5c877b70-645e-404e-92b9-880786582e41" status: 409 len: 152 microversion: 2.1 time: 0.124532 Jul 29 11:50:22.075429 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 231/473] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Jul 29 11:50:21 2022] DELETE /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/os-volume_attachments/5c877b70-645e-404e-92b9-880786582e41 => generated 152 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 29 11:50:22.078465 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-db19e410-49ef-4e9b-ad31-a169caaab94d tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:22.079053 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-db19e410-49ef-4e9b-ad31-a169caaab94d tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:22.085441 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-db19e410-49ef-4e9b-ad31-a169caaab94d tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:22.085902 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-db19e410-49ef-4e9b-ad31-a169caaab94d tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:22.086684 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-db19e410-49ef-4e9b-ad31-a169caaab94d tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:22.087124 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-db19e410-49ef-4e9b-ad31-a169caaab94d tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:22.164893 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-db19e410-49ef-4e9b-ad31-a169caaab94d tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "POST /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/action" status: 202 len: 0 microversion: 2.1 time: 0.090885 Jul 29 11:50:22.165795 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 243/474] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Jul 29 11:50:22 2022] POST /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:50:22.176628 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-915d6f6b-30a7-4660-9a47-18bc97a7314f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:22.178212 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-915d6f6b-30a7-4660-9a47-18bc97a7314f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:22.189482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-915d6f6b-30a7-4660-9a47-18bc97a7314f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:22.191174 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-915d6f6b-30a7-4660-9a47-18bc97a7314f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:22.193547 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-915d6f6b-30a7-4660-9a47-18bc97a7314f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:22.196172 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-915d6f6b-30a7-4660-9a47-18bc97a7314f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:22.437571 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-915d6f6b-30a7-4660-9a47-18bc97a7314f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:22.445580 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-915d6f6b-30a7-4660-9a47-18bc97a7314f tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1723 microversion: 2.1 time: 0.274908 Jul 29 11:50:22.446145 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 232/475] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:22 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:22.692782 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-53885671-ea96-488f-a519-967362662056 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:22.693673 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-53885671-ea96-488f-a519-967362662056 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:22.699889 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-53885671-ea96-488f-a519-967362662056 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:22.700427 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-53885671-ea96-488f-a519-967362662056 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:22.701618 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-53885671-ea96-488f-a519-967362662056 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:22.702059 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-53885671-ea96-488f-a519-967362662056 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:22.715870 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-53885671-ea96-488f-a519-967362662056 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] HTTP exception thrown: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-53885671-ea96-488f-a519-967362662056 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Request method failure captured: Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 HTTP/1.1 Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48icVbGQpo_IdH8_u62UoQcPfoUo3xwllOW7fjakcJXUphVjQAJzVqE7fI-fsqP3g4NqZjz8YFLyejjO-VLv92lJBWa3RdJ2AtZ841GWsHIbm-PB-ZcSKgDGNNp_FYxiDV5ReNSeL7mFuVa5RErCcpxqZKkcIeuKO_mbw7bKo_jOIw8 Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:50:22.718485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:50:22.719991 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4b9969357142bc8724804eb47e0c48", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:50:22.719991 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:50:22.719991 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:50:22.719991 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:50:22.719991 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:50:22.719991 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:50:22.719991 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:50:22.719991 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 1a343996462b462d86fb89b876f4e127 Jul 29 11:50:22.719991 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:50:22.719991 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:50:22.719991 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. Jul 29 11:50:22.719991 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '5c8a2d21-648a-4b70-badd-2d7e499f5b90'} Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:50:22.721198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. Jul 29 11:50:22.722630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:22.723846 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-53885671-ea96-488f-a519-967362662056 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Returning 404 to user: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:50:22.723846 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-53885671-ea96-488f-a519-967362662056 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 404 len: 111 microversion: 2.1 time: 0.031347 Jul 29 11:50:22.723846 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 244/476] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:22 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:50:22.728591 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9f32ce23-a856-4dde-ae44-3bc22c0caa28 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '.version_select at 0x7f68fa0d3dc0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:22.748765 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9f32ce23-a856-4dde-ae44-3bc22c0caa28 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790542709" status: 202 len: 0 microversion: 2.1 time: 0.023645 Jul 29 11:50:22.749342 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 233/477] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Jul 29 11:50:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790542709 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:50:23.468625 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f960f8c6-dd56-40c8-b3b2-d1806d88f041 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:23.469244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f960f8c6-dd56-40c8-b3b2-d1806d88f041 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:23.476456 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f960f8c6-dd56-40c8-b3b2-d1806d88f041 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:23.476973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f960f8c6-dd56-40c8-b3b2-d1806d88f041 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:23.477880 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f960f8c6-dd56-40c8-b3b2-d1806d88f041 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:23.478547 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f960f8c6-dd56-40c8-b3b2-d1806d88f041 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:23.661134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c2b74985-b4c9-4d4a-895a-607bb8bce9fa tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Action: 'create', calling method: .version_select at 0x7f68fa109b80>, body: {"keypair": {"name": "tempest-keypair-703280080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFP5+HltqQ3KTKnIOwG004N6Abeheq2ohOPZeho6N7yOWpFr7GL3pkCY0SQidpHnAczxNwtIQFecqxsloZl+JXgvk6PoZaT+FIy4EIo5BJ/3qpw+53KvZGca2+A22cikQ=="}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:23.678483 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-c2b74985-b4c9-4d4a-895a-607bb8bce9fa tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Getting quotas for project 6a4b9969357142bc8724804eb47e0c48. Resources: {'key_pairs'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:50:23.678824 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f960f8c6-dd56-40c8-b3b2-d1806d88f041 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:23.682667 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-c2b74985-b4c9-4d4a-895a-607bb8bce9fa tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Getting quotas for user 1a343996462b462d86fb89b876f4e127 and project 6a4b9969357142bc8724804eb47e0c48. Resources: {'key_pairs'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:50:23.686739 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f960f8c6-dd56-40c8-b3b2-d1806d88f041 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1723 microversion: 2.1 time: 0.222579 Jul 29 11:50:23.687288 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 245/478] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:23 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:23.711621 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-c2b74985-b4c9-4d4a-895a-607bb8bce9fa tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054706 Jul 29 11:50:23.712209 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 234/479] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Jul 29 11:50:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:24.708157 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e6b4c1cc-bb3c-4b42-abb3-c6f050240937 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:24.709043 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e6b4c1cc-bb3c-4b42-abb3-c6f050240937 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:24.717140 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e6b4c1cc-bb3c-4b42-abb3-c6f050240937 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:24.717654 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e6b4c1cc-bb3c-4b42-abb3-c6f050240937 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:24.718451 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e6b4c1cc-bb3c-4b42-abb3-c6f050240937 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:24.718893 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e6b4c1cc-bb3c-4b42-abb3-c6f050240937 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:24.723162 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:24.952044 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e6b4c1cc-bb3c-4b42-abb3-c6f050240937 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:24.960280 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e6b4c1cc-bb3c-4b42-abb3-c6f050240937 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1723 microversion: 2.1 time: 0.256016 Jul 29 11:50:24.960875 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 246/480] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:24 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:25.021223 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4f1dcd8b-4eff-4dac-81c4-b25fbaf7d78e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-69359548", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8c1956d-5393-448f-8fc5-93aafd4768ba"}], "security_groups": [{"name": "tempest-securitygroup--655561119"}], "key_name": "tempest-keypair-703280080", "user_data": "}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:25.120433 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.network.neutron [None req-4f1dcd8b-4eff-4dac-81c4-b25fbaf7d78e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] validate_networks() for [('b8c1956d-5393-448f-8fc5-93aafd4768ba', None, None, None, None, None)] {{(pid=129585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:50:25.485330 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-4f1dcd8b-4eff-4dac-81c4-b25fbaf7d78e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Flavor limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:50:25.485801 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-4f1dcd8b-4eff-4dac-81c4-b25fbaf7d78e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Image limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:50:25.486270 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-4f1dcd8b-4eff-4dac-81c4-b25fbaf7d78e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Flavor pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:50:25.486678 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-4f1dcd8b-4eff-4dac-81c4-b25fbaf7d78e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Image pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:50:25.487085 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-4f1dcd8b-4eff-4dac-81c4-b25fbaf7d78e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:50:25.496553 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4f1dcd8b-4eff-4dac-81c4-b25fbaf7d78e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:25.496997 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4f1dcd8b-4eff-4dac-81c4-b25fbaf7d78e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:25.497853 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4f1dcd8b-4eff-4dac-81c4-b25fbaf7d78e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:25.498286 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4f1dcd8b-4eff-4dac-81c4-b25fbaf7d78e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:25.515456 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-4f1dcd8b-4eff-4dac-81c4-b25fbaf7d78e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Getting quotas for project 6a4b9969357142bc8724804eb47e0c48. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:50:25.519448 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-4f1dcd8b-4eff-4dac-81c4-b25fbaf7d78e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Getting quotas for user 1a343996462b462d86fb89b876f4e127 and project 6a4b9969357142bc8724804eb47e0c48. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:50:25.531082 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4f1dcd8b-4eff-4dac-81c4-b25fbaf7d78e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Going to run 1 instances... {{(pid=129585) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:50:25.533316 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4f1dcd8b-4eff-4dac-81c4-b25fbaf7d78e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:50:25.555450 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:25.582646 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4f1dcd8b-4eff-4dac-81c4-b25fbaf7d78e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.566359 Jul 29 11:50:25.583615 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 235/481] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:50:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 11:50:25.594604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-abd12157-c35e-40cf-bbe1-c9070a469031 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:25.595214 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-abd12157-c35e-40cf-bbe1-c9070a469031 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:25.653024 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-abd12157-c35e-40cf-bbe1-c9070a469031 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:25.659774 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-abd12157-c35e-40cf-bbe1-c9070a469031 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1239 microversion: 2.1 time: 0.069696 Jul 29 11:50:25.660347 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 247/482] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:25 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:25.983992 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-12dce4ef-dc0a-4195-a482-189cfd722f12 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:25.984534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-12dce4ef-dc0a-4195-a482-189cfd722f12 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:25.991513 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-12dce4ef-dc0a-4195-a482-189cfd722f12 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:25.991975 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-12dce4ef-dc0a-4195-a482-189cfd722f12 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:25.992750 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-12dce4ef-dc0a-4195-a482-189cfd722f12 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:25.993195 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-12dce4ef-dc0a-4195-a482-189cfd722f12 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:26.123652 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-12dce4ef-dc0a-4195-a482-189cfd722f12 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:26.131678 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-12dce4ef-dc0a-4195-a482-189cfd722f12 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1723 microversion: 2.1 time: 0.153018 Jul 29 11:50:26.132247 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 236/483] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:25 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:26.680116 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-a93c9497-8842-472c-be4d-bd0a7a2d9d93 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:26.680886 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-a93c9497-8842-472c-be4d-bd0a7a2d9d93 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:26.687556 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a93c9497-8842-472c-be4d-bd0a7a2d9d93 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:26.688240 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a93c9497-8842-472c-be4d-bd0a7a2d9d93 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:26.689008 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a93c9497-8842-472c-be4d-bd0a7a2d9d93 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:26.689467 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a93c9497-8842-472c-be4d-bd0a7a2d9d93 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:26.775001 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a93c9497-8842-472c-be4d-bd0a7a2d9d93 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:26.783995 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-a93c9497-8842-472c-be4d-bd0a7a2d9d93 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1243 microversion: 2.1 time: 0.107648 Jul 29 11:50:26.784572 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 248/484] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:26 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1243 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:27.155384 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-29fbe4d5-6d49-42ef-a3a1-c8e149e094f1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:27.155940 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-29fbe4d5-6d49-42ef-a3a1-c8e149e094f1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:27.162292 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-29fbe4d5-6d49-42ef-a3a1-c8e149e094f1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:27.162751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-29fbe4d5-6d49-42ef-a3a1-c8e149e094f1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:27.163679 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-29fbe4d5-6d49-42ef-a3a1-c8e149e094f1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:27.164127 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-29fbe4d5-6d49-42ef-a3a1-c8e149e094f1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:27.301726 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-29fbe4d5-6d49-42ef-a3a1-c8e149e094f1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:27.309665 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-29fbe4d5-6d49-42ef-a3a1-c8e149e094f1 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1723 microversion: 2.1 time: 0.159635 Jul 29 11:50:27.310856 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 237/485] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:27 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:27.805395 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-2f17984e-fdcf-48a3-b857-d209a1359203 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:27.806031 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-2f17984e-fdcf-48a3-b857-d209a1359203 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:27.808391 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:27.814046 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2f17984e-fdcf-48a3-b857-d209a1359203 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:27.814514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2f17984e-fdcf-48a3-b857-d209a1359203 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:27.815257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2f17984e-fdcf-48a3-b857-d209a1359203 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:27.815683 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2f17984e-fdcf-48a3-b857-d209a1359203 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:27.877274 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2f17984e-fdcf-48a3-b857-d209a1359203 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:27.884592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-2f17984e-fdcf-48a3-b857-d209a1359203 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1235 microversion: 2.1 time: 0.083129 Jul 29 11:50:27.885151 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 249/486] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:27 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1235 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:28.334641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ca298979-705c-4297-9e70-8c33bb239bef tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:28.335328 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ca298979-705c-4297-9e70-8c33bb239bef tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:28.342830 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ca298979-705c-4297-9e70-8c33bb239bef tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:28.343293 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ca298979-705c-4297-9e70-8c33bb239bef tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:28.344071 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ca298979-705c-4297-9e70-8c33bb239bef tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:28.344513 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ca298979-705c-4297-9e70-8c33bb239bef tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:28.530862 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ca298979-705c-4297-9e70-8c33bb239bef tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:28.539194 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ca298979-705c-4297-9e70-8c33bb239bef tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1729 microversion: 2.1 time: 0.209928 Jul 29 11:50:28.540161 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 238/487] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:28 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:28.553331 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6c05d7a0-6dff-4277-af04-68503e3016c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:28.554190 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6c05d7a0-6dff-4277-af04-68503e3016c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:28.560548 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6c05d7a0-6dff-4277-af04-68503e3016c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:28.565304 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ad44511e-bbd6-42bb-8c40-455163cb3f56 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:28.565869 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6c05d7a0-6dff-4277-af04-68503e3016c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:28.566802 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6c05d7a0-6dff-4277-af04-68503e3016c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:28.566938 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ad44511e-bbd6-42bb-8c40-455163cb3f56 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:28.567377 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6c05d7a0-6dff-4277-af04-68503e3016c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:28.572895 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ad44511e-bbd6-42bb-8c40-455163cb3f56 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:28.573341 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ad44511e-bbd6-42bb-8c40-455163cb3f56 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:28.574208 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ad44511e-bbd6-42bb-8c40-455163cb3f56 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:28.574642 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ad44511e-bbd6-42bb-8c40-455163cb3f56 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:28.598200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-6c05d7a0-6dff-4277-af04-68503e3016c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/os-volume_attachments/c258df52-a481-461c-960e-3ae925eca729" status: 200 len: 194 microversion: 2.20 time: 0.048783 Jul 29 11:50:28.598899 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 250/488] 10.222.0.60 () {60 vars in 1454 bytes} [Fri Jul 29 11:50:28 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/os-volume_attachments/c258df52-a481-461c-960e-3ae925eca729 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 11:50:28.672726 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e4c27fc8-ce3b-46e9-8bcf-03ccd1a5d25f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:28.674858 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e4c27fc8-ce3b-46e9-8bcf-03ccd1a5d25f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:28.680970 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e4c27fc8-ce3b-46e9-8bcf-03ccd1a5d25f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:28.681603 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e4c27fc8-ce3b-46e9-8bcf-03ccd1a5d25f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:28.682444 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e4c27fc8-ce3b-46e9-8bcf-03ccd1a5d25f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:28.682943 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e4c27fc8-ce3b-46e9-8bcf-03ccd1a5d25f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:28.696063 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ad44511e-bbd6-42bb-8c40-455163cb3f56 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134506 Jul 29 11:50:28.697375 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 239/489] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Jul 29 11:50:28 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:28.794394 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-e4c27fc8-ce3b-46e9-8bcf-03ccd1a5d25f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lazy-loading 'services' on Instance uuid d7bd0b02-2726-4432-a6a1-53035c9a1978 {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:50:28.873617 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e4c27fc8-ce3b-46e9-8bcf-03ccd1a5d25f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/os-volume_attachments/c258df52-a481-461c-960e-3ae925eca729" status: 202 len: 0 microversion: 2.20 time: 0.205021 Jul 29 11:50:28.874946 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 251/490] 10.222.0.60 () {60 vars in 1457 bytes} [Fri Jul 29 11:50:28 2022] DELETE /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/os-volume_attachments/c258df52-a481-461c-960e-3ae925eca729 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 29 11:50:28.888983 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-599f504b-f4ec-4091-a974-cf7f08375f69 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:28.892443 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-599f504b-f4ec-4091-a974-cf7f08375f69 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:28.899971 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-599f504b-f4ec-4091-a974-cf7f08375f69 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:28.900656 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-599f504b-f4ec-4091-a974-cf7f08375f69 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:28.902120 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-599f504b-f4ec-4091-a974-cf7f08375f69 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:28.902555 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-599f504b-f4ec-4091-a974-cf7f08375f69 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:28.907480 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3a4113b1-b082-4fc3-8658-6c9b16924b15 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:28.908431 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3a4113b1-b082-4fc3-8658-6c9b16924b15 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:28.925325 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3a4113b1-b082-4fc3-8658-6c9b16924b15 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:28.926098 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3a4113b1-b082-4fc3-8658-6c9b16924b15 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:28.927366 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3a4113b1-b082-4fc3-8658-6c9b16924b15 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:28.928125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3a4113b1-b082-4fc3-8658-6c9b16924b15 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:28.946606 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-599f504b-f4ec-4091-a974-cf7f08375f69 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066459 Jul 29 11:50:28.952414 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 240/491] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Jul 29 11:50:28 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 11:50:29.023317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3a4113b1-b082-4fc3-8658-6c9b16924b15 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:29.031790 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3a4113b1-b082-4fc3-8658-6c9b16924b15 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1297 microversion: 2.1 time: 0.128744 Jul 29 11:50:29.039150 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 252/492] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:28 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1297 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:29.960301 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-3e8cb54f-b1b9-413d-9347-5c0b550de807 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:29.963430 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-3e8cb54f-b1b9-413d-9347-5c0b550de807 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:29.976483 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3e8cb54f-b1b9-413d-9347-5c0b550de807 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:29.977316 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3e8cb54f-b1b9-413d-9347-5c0b550de807 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:29.978363 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3e8cb54f-b1b9-413d-9347-5c0b550de807 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:29.978863 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3e8cb54f-b1b9-413d-9347-5c0b550de807 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:30.012048 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-3e8cb54f-b1b9-413d-9347-5c0b550de807 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055696 Jul 29 11:50:30.013901 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 241/493] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Jul 29 11:50:29 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:30.048327 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-9f90136c-8427-4498-a2f5-8fce0d827a33 req-b8d973ac-e15e-4ab2-87e8-c8e916149f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "439cbe53-546a-4902-a4e7-c25b4a7b84d0", "tag": "df601806-d30d-4808-ad00-6cb495f89154"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:30.052629 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-60b865e0-dcc3-40bc-806a-37e04f229eb0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:30.053358 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-60b865e0-dcc3-40bc-806a-37e04f229eb0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:30.062368 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-60b865e0-dcc3-40bc-806a-37e04f229eb0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:30.063912 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-60b865e0-dcc3-40bc-806a-37e04f229eb0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:30.065938 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-60b865e0-dcc3-40bc-806a-37e04f229eb0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:30.066768 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-60b865e0-dcc3-40bc-806a-37e04f229eb0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:30.077837 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-9f90136c-8427-4498-a2f5-8fce0d827a33 req-b8d973ac-e15e-4ab2-87e8-c8e916149f3e service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:30.078289 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-9f90136c-8427-4498-a2f5-8fce0d827a33 req-b8d973ac-e15e-4ab2-87e8-c8e916149f3e service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:30.108363 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-9f90136c-8427-4498-a2f5-8fce0d827a33 req-b8d973ac-e15e-4ab2-87e8-c8e916149f3e service nova] Creating event network-changed:df601806-d30d-4808-ad00-6cb495f89154 for instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 on hv-cinder-83754 Jul 29 11:50:30.123015 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-9f90136c-8427-4498-a2f5-8fce0d827a33 req-b8d973ac-e15e-4ab2-87e8-c8e916149f3e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078348 Jul 29 11:50:30.125273 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 253/494] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:30.153903 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-496fc1bd-aff0-467e-bbff-95b793ec5df9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:30.154682 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-496fc1bd-aff0-467e-bbff-95b793ec5df9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:30.166512 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-496fc1bd-aff0-467e-bbff-95b793ec5df9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:30.167058 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-496fc1bd-aff0-467e-bbff-95b793ec5df9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:30.167936 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-496fc1bd-aff0-467e-bbff-95b793ec5df9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:30.168446 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-496fc1bd-aff0-467e-bbff-95b793ec5df9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:30.209198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-496fc1bd-aff0-467e-bbff-95b793ec5df9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Going to try to terminate instance {{(pid=129584) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:50:30.318803 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-496fc1bd-aff0-467e-bbff-95b793ec5df9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 204 len: 0 microversion: 2.20 time: 0.170680 Jul 29 11:50:30.320409 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 254/495] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Jul 29 11:50:30 2022] DELETE /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 11:50:30.338990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-fc583b67-ecb5-424d-a9c5-7af88a1e3155 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:30.340679 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-fc583b67-ecb5-424d-a9c5-7af88a1e3155 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:30.347495 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fc583b67-ecb5-424d-a9c5-7af88a1e3155 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:30.348080 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fc583b67-ecb5-424d-a9c5-7af88a1e3155 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:30.348965 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fc583b67-ecb5-424d-a9c5-7af88a1e3155 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:30.349495 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fc583b67-ecb5-424d-a9c5-7af88a1e3155 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:30.376298 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-60b865e0-dcc3-40bc-806a-37e04f229eb0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:30.384115 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-60b865e0-dcc3-40bc-806a-37e04f229eb0 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1364 microversion: 2.1 time: 0.335687 Jul 29 11:50:30.384686 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 242/496] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:30 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1364 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:30.393082 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-0f5e5d30-4d57-4cf3-96b9-fd065016d433 req-aba46c0f-d96b-415d-b22e-43aab6eb6c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b4f838-c329-43d2-8448-82ad1ee8ad2a", "tag": "666ba69f-5b53-402b-9db5-8013b146c1da"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:30.404277 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-0f5e5d30-4d57-4cf3-96b9-fd065016d433 req-aba46c0f-d96b-415d-b22e-43aab6eb6c8b service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:30.404815 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-0f5e5d30-4d57-4cf3-96b9-fd065016d433 req-aba46c0f-d96b-415d-b22e-43aab6eb6c8b service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:30.416296 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-0f5e5d30-4d57-4cf3-96b9-fd065016d433 req-aba46c0f-d96b-415d-b22e-43aab6eb6c8b service nova] Creating event network-changed:666ba69f-5b53-402b-9db5-8013b146c1da for instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a on hv-cinder-83754 Jul 29 11:50:30.421938 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-0f5e5d30-4d57-4cf3-96b9-fd065016d433 req-aba46c0f-d96b-415d-b22e-43aab6eb6c8b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035901 Jul 29 11:50:30.422526 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 243/497] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:30.495407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-fc583b67-ecb5-424d-a9c5-7af88a1e3155 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:30.503866 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-fc583b67-ecb5-424d-a9c5-7af88a1e3155 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:30.505364 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-fc583b67-ecb5-424d-a9c5-7af88a1e3155 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:30.506553 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-fc583b67-ecb5-424d-a9c5-7af88a1e3155 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.179873 Jul 29 11:50:30.507114 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 255/498] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:50:30 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:50:31.406895 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-0d936cb2-6d1b-4c79-9379-29286c0099df tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:31.407595 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-0d936cb2-6d1b-4c79-9379-29286c0099df tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:31.413805 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0d936cb2-6d1b-4c79-9379-29286c0099df tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:31.414256 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0d936cb2-6d1b-4c79-9379-29286c0099df tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:31.415019 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0d936cb2-6d1b-4c79-9379-29286c0099df tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:31.415456 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0d936cb2-6d1b-4c79-9379-29286c0099df tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:31.418066 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=100 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:31.531158 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-21bc8a8f-7f1b-4488-8075-e6a3adf6391c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:31.531843 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-21bc8a8f-7f1b-4488-8075-e6a3adf6391c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:31.538721 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-21bc8a8f-7f1b-4488-8075-e6a3adf6391c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:31.539253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-21bc8a8f-7f1b-4488-8075-e6a3adf6391c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:31.540097 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-21bc8a8f-7f1b-4488-8075-e6a3adf6391c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:31.540604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-21bc8a8f-7f1b-4488-8075-e6a3adf6391c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:31.548977 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-0d936cb2-6d1b-4c79-9379-29286c0099df tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:31.556690 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-0d936cb2-6d1b-4c79-9379-29286c0099df tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1364 microversion: 2.1 time: 0.154477 Jul 29 11:50:31.557285 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 244/499] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:31 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:31.670490 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-21bc8a8f-7f1b-4488-8075-e6a3adf6391c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:31.678508 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-21bc8a8f-7f1b-4488-8075-e6a3adf6391c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:31.679999 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-21bc8a8f-7f1b-4488-8075-e6a3adf6391c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:31.681133 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-21bc8a8f-7f1b-4488-8075-e6a3adf6391c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.154904 Jul 29 11:50:31.681716 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 256/500] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:50:31 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:50:32.436812 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-02a4d80f-7cda-4fd5-8c61-56cc91e72b45 req-9cb8f6a9-caad-4368-be97-fba5896d1c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b4f838-c329-43d2-8448-82ad1ee8ad2a", "tag": "666ba69f-5b53-402b-9db5-8013b146c1da"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:32.446651 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-02a4d80f-7cda-4fd5-8c61-56cc91e72b45 req-9cb8f6a9-caad-4368-be97-fba5896d1c15 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:32.447039 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-02a4d80f-7cda-4fd5-8c61-56cc91e72b45 req-9cb8f6a9-caad-4368-be97-fba5896d1c15 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:32.458101 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-02a4d80f-7cda-4fd5-8c61-56cc91e72b45 req-9cb8f6a9-caad-4368-be97-fba5896d1c15 service nova] Creating event network-changed:666ba69f-5b53-402b-9db5-8013b146c1da for instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a on hv-cinder-83754 Jul 29 11:50:32.462695 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-02a4d80f-7cda-4fd5-8c61-56cc91e72b45 req-9cb8f6a9-caad-4368-be97-fba5896d1c15 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029771 Jul 29 11:50:32.463265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 245/501] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:32.577937 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d1e9d2c0-7f8a-4355-810c-2aae905048a7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:32.578718 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d1e9d2c0-7f8a-4355-810c-2aae905048a7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:32.585432 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d1e9d2c0-7f8a-4355-810c-2aae905048a7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:32.585900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d1e9d2c0-7f8a-4355-810c-2aae905048a7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:32.586662 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d1e9d2c0-7f8a-4355-810c-2aae905048a7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:32.587097 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d1e9d2c0-7f8a-4355-810c-2aae905048a7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:32.705703 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-69a0128c-f8a9-48b5-8bfb-e19f4db8a671 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:32.706432 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-69a0128c-f8a9-48b5-8bfb-e19f4db8a671 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:32.712632 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-69a0128c-f8a9-48b5-8bfb-e19f4db8a671 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:32.713091 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-69a0128c-f8a9-48b5-8bfb-e19f4db8a671 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:32.713965 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-69a0128c-f8a9-48b5-8bfb-e19f4db8a671 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:32.714336 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d1e9d2c0-7f8a-4355-810c-2aae905048a7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:32.714496 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-69a0128c-f8a9-48b5-8bfb-e19f4db8a671 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:32.722037 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d1e9d2c0-7f8a-4355-810c-2aae905048a7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1364 microversion: 2.1 time: 0.148484 Jul 29 11:50:32.722606 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 257/502] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:32 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:32.843350 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-69a0128c-f8a9-48b5-8bfb-e19f4db8a671 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:32.851415 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-69a0128c-f8a9-48b5-8bfb-e19f4db8a671 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:32.852908 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-69a0128c-f8a9-48b5-8bfb-e19f4db8a671 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:32.854098 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-69a0128c-f8a9-48b5-8bfb-e19f4db8a671 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.153686 Jul 29 11:50:32.854649 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 246/503] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:50:32 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:50:33.742398 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-181cba1e-9e6e-4943-8053-ea1e9016a71e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:33.742991 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-181cba1e-9e6e-4943-8053-ea1e9016a71e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:33.749954 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-181cba1e-9e6e-4943-8053-ea1e9016a71e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:33.750414 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-181cba1e-9e6e-4943-8053-ea1e9016a71e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:33.751365 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-181cba1e-9e6e-4943-8053-ea1e9016a71e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:33.751815 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-181cba1e-9e6e-4943-8053-ea1e9016a71e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:33.885038 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-87ab2d6a-9fdf-4590-8348-07bff24a24bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:33.886091 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-87ab2d6a-9fdf-4590-8348-07bff24a24bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:33.901775 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-87ab2d6a-9fdf-4590-8348-07bff24a24bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:33.902719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-87ab2d6a-9fdf-4590-8348-07bff24a24bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:33.904480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-87ab2d6a-9fdf-4590-8348-07bff24a24bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:33.905087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-87ab2d6a-9fdf-4590-8348-07bff24a24bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:33.969926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-181cba1e-9e6e-4943-8053-ea1e9016a71e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:33.977437 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-181cba1e-9e6e-4943-8053-ea1e9016a71e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1364 microversion: 2.1 time: 0.238913 Jul 29 11:50:33.978122 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 258/504] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:33 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:34.111598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-87ab2d6a-9fdf-4590-8348-07bff24a24bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:34.120794 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-87ab2d6a-9fdf-4590-8348-07bff24a24bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:34.122843 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-87ab2d6a-9fdf-4590-8348-07bff24a24bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:34.124017 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-87ab2d6a-9fdf-4590-8348-07bff24a24bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.251788 Jul 29 11:50:34.124644 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 247/505] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:50:33 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:50:34.998524 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e5a7126b-f2db-4e6d-88d2-ea1e3f50426e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:34.999301 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e5a7126b-f2db-4e6d-88d2-ea1e3f50426e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:35.009661 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e5a7126b-f2db-4e6d-88d2-ea1e3f50426e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:35.010124 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e5a7126b-f2db-4e6d-88d2-ea1e3f50426e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:35.011177 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e5a7126b-f2db-4e6d-88d2-ea1e3f50426e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:35.011623 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e5a7126b-f2db-4e6d-88d2-ea1e3f50426e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:35.147122 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-408199cb-4063-4a1a-a74f-2310015353d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:35.147732 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-408199cb-4063-4a1a-a74f-2310015353d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:35.154256 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-408199cb-4063-4a1a-a74f-2310015353d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:35.155072 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-408199cb-4063-4a1a-a74f-2310015353d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:35.156093 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-408199cb-4063-4a1a-a74f-2310015353d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:35.156785 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-408199cb-4063-4a1a-a74f-2310015353d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:35.390434 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e5a7126b-f2db-4e6d-88d2-ea1e3f50426e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:35.416884 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e5a7126b-f2db-4e6d-88d2-ea1e3f50426e tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1364 microversion: 2.1 time: 0.422083 Jul 29 11:50:35.423949 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 259/506] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:34 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1364 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:35.507960 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:35.526514 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=10 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:35.554168 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-408199cb-4063-4a1a-a74f-2310015353d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:35.564414 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-408199cb-4063-4a1a-a74f-2310015353d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:35.566282 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-408199cb-4063-4a1a-a74f-2310015353d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:35.567583 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-408199cb-4063-4a1a-a74f-2310015353d2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1724 microversion: 2.20 time: 0.424371 Jul 29 11:50:35.568248 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 248/507] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:50:35 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1724 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:50:36.438130 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-74c155fa-9981-4a1c-879e-8955208f6ad3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:36.438931 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-74c155fa-9981-4a1c-879e-8955208f6ad3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:36.440955 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=2 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:36.447192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-74c155fa-9981-4a1c-879e-8955208f6ad3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:36.447644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-74c155fa-9981-4a1c-879e-8955208f6ad3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:36.448630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-74c155fa-9981-4a1c-879e-8955208f6ad3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:36.449074 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-74c155fa-9981-4a1c-879e-8955208f6ad3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:36.597214 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-74c155fa-9981-4a1c-879e-8955208f6ad3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:36.607320 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5a47ab8b-6e05-4313-b592-5223d797e655 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:36.607853 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-74c155fa-9981-4a1c-879e-8955208f6ad3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1364 microversion: 2.1 time: 0.173542 Jul 29 11:50:36.607939 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-5a47ab8b-6e05-4313-b592-5223d797e655 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:36.608644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 260/508] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:36 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:36.619871 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5a47ab8b-6e05-4313-b592-5223d797e655 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:36.620364 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5a47ab8b-6e05-4313-b592-5223d797e655 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:36.621677 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5a47ab8b-6e05-4313-b592-5223d797e655 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:36.622315 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5a47ab8b-6e05-4313-b592-5223d797e655 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:36.720371 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-5a47ab8b-6e05-4313-b592-5223d797e655 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:36.730801 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-5a47ab8b-6e05-4313-b592-5223d797e655 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:36.733043 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-5a47ab8b-6e05-4313-b592-5223d797e655 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:36.734621 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-5a47ab8b-6e05-4313-b592-5223d797e655 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 200 len: 1657 microversion: 2.20 time: 0.131397 Jul 29 11:50:36.735192 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 249/509] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:50:36 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 1657 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:50:36.771803 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-bc189c20-0014-4809-b8c8-51d1d681f9ff req-a16cc6b0-8d0b-465e-8adc-3abe6fc40138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7bd0b02-2726-4432-a6a1-53035c9a1978", "name": "network-vif-deleted", "tag": "fb1642b2-a468-43c6-8233-7e7bcc25cfcd"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:36.798706 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-bc189c20-0014-4809-b8c8-51d1d681f9ff req-a16cc6b0-8d0b-465e-8adc-3abe6fc40138 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:36.799292 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-bc189c20-0014-4809-b8c8-51d1d681f9ff req-a16cc6b0-8d0b-465e-8adc-3abe6fc40138 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:36.817067 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-bc189c20-0014-4809-b8c8-51d1d681f9ff req-a16cc6b0-8d0b-465e-8adc-3abe6fc40138 service nova] Creating event network-vif-deleted:fb1642b2-a468-43c6-8233-7e7bcc25cfcd for instance d7bd0b02-2726-4432-a6a1-53035c9a1978 on hv-cinder-83754 Jul 29 11:50:36.823017 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-bc189c20-0014-4809-b8c8-51d1d681f9ff req-a16cc6b0-8d0b-465e-8adc-3abe6fc40138 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055043 Jul 29 11:50:36.824209 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 261/510] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:37.628612 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-12c77a31-13e0-45c3-8196-3eb7202efeae tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:37.629222 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-12c77a31-13e0-45c3-8196-3eb7202efeae tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:37.636906 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-12c77a31-13e0-45c3-8196-3eb7202efeae tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:37.637357 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-12c77a31-13e0-45c3-8196-3eb7202efeae tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:37.638733 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-12c77a31-13e0-45c3-8196-3eb7202efeae tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:37.639146 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-12c77a31-13e0-45c3-8196-3eb7202efeae tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:37.758408 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ccf3de53-ed23-45bf-a058-bdc76a42bc75 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:37.759727 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ccf3de53-ed23-45bf-a058-bdc76a42bc75 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:37.767618 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ccf3de53-ed23-45bf-a058-bdc76a42bc75 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:37.768695 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ccf3de53-ed23-45bf-a058-bdc76a42bc75 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:37.769676 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ccf3de53-ed23-45bf-a058-bdc76a42bc75 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:37.770298 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ccf3de53-ed23-45bf-a058-bdc76a42bc75 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:37.785081 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-ccf3de53-ed23-45bf-a058-bdc76a42bc75 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] HTTP exception thrown: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. Jul 29 11:50:37.788314 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-12c77a31-13e0-45c3-8196-3eb7202efeae tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ccf3de53-ed23-45bf-a058-bdc76a42bc75 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Request method failure captured: Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 HTTP/1.1 Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48iWtquXP-sIy6Pg2mXeCJeu8cOd9bTOMo_weOHlmXUJ7k8ytjjywePILXvm8gLQczQzuxDILJ_wMX-profRnhSAwhNVjXD0V-zZxJ_bMDnSGsdfJT1vG9FfZR43Uav5QY7b6H9T_08WsKwZjwPSV6s-rVGQdZ5MisBIwUeEnKsW5BI Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 90047b9130334326ad98280a8edb2bc6 Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:50:37.793566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:50:37.795338 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_90047b9130334326ad98280a8edb2bc6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:50:37.795338 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:50:37.795338 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 90047b9130334326ad98280a8edb2bc6 Jul 29 11:50:37.795338 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:50:37.795338 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-AttachVolumeShelveTestJSON-49761931-project Jul 29 11:50:37.795338 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:50:37.795338 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:50:37.795338 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: ee3506015d9240258cbada860704dffe Jul 29 11:50:37.795338 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49761931-project Jul 29 11:50:37.795338 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:50:37.795338 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. Jul 29 11:50:37.795338 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': 'd7bd0b02-2726-4432-a6a1-53035c9a1978'} Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:50:37.796257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. Jul 29 11:50:37.797701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:50:37.800305 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ccf3de53-ed23-45bf-a058-bdc76a42bc75 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Returning 404 to user: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:50:37.800305 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ccf3de53-ed23-45bf-a058-bdc76a42bc75 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 404 len: 111 microversion: 2.20 time: 0.041523 Jul 29 11:50:37.804018 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-12c77a31-13e0-45c3-8196-3eb7202efeae tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1364 microversion: 2.1 time: 0.179335 Jul 29 11:50:37.804914 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 250/511] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:37 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:37.810046 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 262/512] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:50:37 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 29 11:50:37.810480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c689f599-bb56-479d-8a65-ba4a81191436 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '.version_select at 0x7f68fa035160>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:37.835831 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-c689f599-bb56-479d-8a65-ba4a81191436 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319657418" status: 204 len: 0 microversion: 2.20 time: 0.029840 Jul 29 11:50:37.836409 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 251/513] 10.222.0.60 () {60 vars in 1262 bytes} [Fri Jul 29 11:50:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319657418 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 11:50:38.500194 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-37465e82-61fb-447e-8515-d5d1ba5a0bfd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Action: 'create', calling method: .version_select at 0x7f68f9f9b3a0>, body: {"keypair": {"name": "tempest-keypair-1101844042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAklli/DFFKKG9sjsNpWeRbXC7KcmFkQ3yJ421U5U66ua+r8o+PhFjX6K682ETQGzQFbPwP5OS7n3UIiX/4pg+T8y7fXfFSzpjtTYl6UTfKXeHVmyvJrzBNwK3s0RXuK+A=="}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:38.516011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-37465e82-61fb-447e-8515-d5d1ba5a0bfd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Getting quotas for project 90047b9130334326ad98280a8edb2bc6. Resources: {'key_pairs'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:50:38.519784 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-37465e82-61fb-447e-8515-d5d1ba5a0bfd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Getting quotas for user ee3506015d9240258cbada860704dffe and project 90047b9130334326ad98280a8edb2bc6. Resources: {'key_pairs'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:50:38.540535 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-37465e82-61fb-447e-8515-d5d1ba5a0bfd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044824 Jul 29 11:50:38.541190 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 263/514] 10.222.0.60 () {62 vars in 1200 bytes} [Fri Jul 29 11:50:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 29 11:50:38.828299 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-fdc0ecca-143f-4bc0-be93-df848429db3f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:38.829583 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-fdc0ecca-143f-4bc0-be93-df848429db3f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:38.836027 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fdc0ecca-143f-4bc0-be93-df848429db3f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:38.836481 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fdc0ecca-143f-4bc0-be93-df848429db3f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:38.837260 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fdc0ecca-143f-4bc0-be93-df848429db3f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:38.837724 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fdc0ecca-143f-4bc0-be93-df848429db3f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:38.996455 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fdc0ecca-143f-4bc0-be93-df848429db3f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:39.005277 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-fdc0ecca-143f-4bc0-be93-df848429db3f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1364 microversion: 2.1 time: 0.181259 Jul 29 11:50:39.006271 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 252/515] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:38 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:39.645993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-a769add4-5389-4cab-b873-2d0d7eaa46d8 req-c1427950-cb02-4c9b-9a65-f6a7727446bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439cbe53-546a-4902-a4e7-c25b4a7b84d0", "name": "network-vif-plugged", "status": "completed", "tag": "df601806-d30d-4808-ad00-6cb495f89154"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:39.658106 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-a769add4-5389-4cab-b873-2d0d7eaa46d8 req-c1427950-cb02-4c9b-9a65-f6a7727446bc service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:39.658860 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-a769add4-5389-4cab-b873-2d0d7eaa46d8 req-c1427950-cb02-4c9b-9a65-f6a7727446bc service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:39.670396 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-a769add4-5389-4cab-b873-2d0d7eaa46d8 req-c1427950-cb02-4c9b-9a65-f6a7727446bc service nova] Creating event network-vif-plugged:df601806-d30d-4808-ad00-6cb495f89154 for instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 on hv-cinder-83754 Jul 29 11:50:39.675190 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-a769add4-5389-4cab-b873-2d0d7eaa46d8 req-c1427950-cb02-4c9b-9a65-f6a7727446bc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034910 Jul 29 11:50:39.675777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 264/516] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:39.860325 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e7a05d89-711b-4c15-a88e-a4afd37d8b7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-27416086", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "880bbcc5-592e-4ef5-8c48-acff52af8368"}], "security_groups": [{"name": "tempest-securitygroup--1230117609"}], "key_name": "tempest-keypair-1101844042", "user_data": "}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:39.964904 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.network.neutron [None req-e7a05d89-711b-4c15-a88e-a4afd37d8b7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] validate_networks() for [('880bbcc5-592e-4ef5-8c48-acff52af8368', None, None, None, None, None)] {{(pid=129585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:50:40.026663 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ea4959a5-0dd4-4960-b660-b16fdf37467a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:40.027907 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ea4959a5-0dd4-4960-b660-b16fdf37467a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:40.034677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ea4959a5-0dd4-4960-b660-b16fdf37467a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:40.035258 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ea4959a5-0dd4-4960-b660-b16fdf37467a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:40.036132 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ea4959a5-0dd4-4960-b660-b16fdf37467a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:40.036680 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ea4959a5-0dd4-4960-b660-b16fdf37467a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:40.041280 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:40.272628 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ea4959a5-0dd4-4960-b660-b16fdf37467a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:40.280756 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ea4959a5-0dd4-4960-b660-b16fdf37467a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1364 microversion: 2.1 time: 0.258588 Jul 29 11:50:40.281527 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 265/517] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:40 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:50:40.413875 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-e7a05d89-711b-4c15-a88e-a4afd37d8b7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Flavor limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:50:40.414309 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-e7a05d89-711b-4c15-a88e-a4afd37d8b7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Image limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:50:40.414788 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-e7a05d89-711b-4c15-a88e-a4afd37d8b7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Flavor pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:50:40.415230 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-e7a05d89-711b-4c15-a88e-a4afd37d8b7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Image pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:50:40.415647 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-e7a05d89-711b-4c15-a88e-a4afd37d8b7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:50:40.425436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e7a05d89-711b-4c15-a88e-a4afd37d8b7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:40.425907 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e7a05d89-711b-4c15-a88e-a4afd37d8b7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:40.426727 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e7a05d89-711b-4c15-a88e-a4afd37d8b7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:40.427162 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e7a05d89-711b-4c15-a88e-a4afd37d8b7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:40.444346 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-e7a05d89-711b-4c15-a88e-a4afd37d8b7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Getting quotas for project 90047b9130334326ad98280a8edb2bc6. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:50:40.448321 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-e7a05d89-711b-4c15-a88e-a4afd37d8b7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Getting quotas for user ee3506015d9240258cbada860704dffe and project 90047b9130334326ad98280a8edb2bc6. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:50:40.459640 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e7a05d89-711b-4c15-a88e-a4afd37d8b7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Going to run 1 instances... {{(pid=129585) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:50:40.461910 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e7a05d89-711b-4c15-a88e-a4afd37d8b7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:50:40.507429 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e7a05d89-711b-4c15-a88e-a4afd37d8b7c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.651651 Jul 29 11:50:40.508067 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 253/518] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Jul 29 11:50:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 29 11:50:40.519295 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f461f677-d19e-42a2-9875-ea8e5894c7bb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:40.519987 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f461f677-d19e-42a2-9875-ea8e5894c7bb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:40.574119 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f461f677-d19e-42a2-9875-ea8e5894c7bb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:40.581365 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f461f677-d19e-42a2-9875-ea8e5894c7bb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:40.582889 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f461f677-d19e-42a2-9875-ea8e5894c7bb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:40.583995 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f461f677-d19e-42a2-9875-ea8e5894c7bb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1280 microversion: 2.20 time: 0.068657 Jul 29 11:50:40.584541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 266/519] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:50:40 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:50:41.302381 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-dc237601-b4d2-4a4e-b8fa-a7377c155dee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:41.303005 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-dc237601-b4d2-4a4e-b8fa-a7377c155dee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:41.312607 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-dc237601-b4d2-4a4e-b8fa-a7377c155dee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:41.313069 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-dc237601-b4d2-4a4e-b8fa-a7377c155dee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:41.313866 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-dc237601-b4d2-4a4e-b8fa-a7377c155dee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:41.314311 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-dc237601-b4d2-4a4e-b8fa-a7377c155dee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:41.448215 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-dc237601-b4d2-4a4e-b8fa-a7377c155dee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:41.455934 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-dc237601-b4d2-4a4e-b8fa-a7377c155dee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1364 microversion: 2.1 time: 0.157438 Jul 29 11:50:41.456505 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 254/520] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:41 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:41.606135 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5149f802-39b0-4ded-8fe6-f7b1b2e07b22 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:41.607238 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-5149f802-39b0-4ded-8fe6-f7b1b2e07b22 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:41.614940 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5149f802-39b0-4ded-8fe6-f7b1b2e07b22 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:41.615479 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5149f802-39b0-4ded-8fe6-f7b1b2e07b22 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:41.616279 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5149f802-39b0-4ded-8fe6-f7b1b2e07b22 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:41.616705 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5149f802-39b0-4ded-8fe6-f7b1b2e07b22 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:41.679114 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5149f802-39b0-4ded-8fe6-f7b1b2e07b22 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:41.687323 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5149f802-39b0-4ded-8fe6-f7b1b2e07b22 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:41.688865 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5149f802-39b0-4ded-8fe6-f7b1b2e07b22 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:41.690015 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-5149f802-39b0-4ded-8fe6-f7b1b2e07b22 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1332 microversion: 2.20 time: 0.087818 Jul 29 11:50:41.690570 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 267/521] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:50:41 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1332 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:50:42.477799 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-93f0b93c-aab7-4383-87b6-50594747e26f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:42.479161 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-93f0b93c-aab7-4383-87b6-50594747e26f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:42.486355 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-93f0b93c-aab7-4383-87b6-50594747e26f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:42.486863 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-93f0b93c-aab7-4383-87b6-50594747e26f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:42.487790 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-93f0b93c-aab7-4383-87b6-50594747e26f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:42.488468 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-93f0b93c-aab7-4383-87b6-50594747e26f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:42.642082 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-93f0b93c-aab7-4383-87b6-50594747e26f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:42.650368 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-93f0b93c-aab7-4383-87b6-50594747e26f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1554 microversion: 2.1 time: 0.177944 Jul 29 11:50:42.650948 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 255/522] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:50:42 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:50:42.672903 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1ce4c13a-bad8-4f80-ac9d-bf6a664191d5 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:42.673495 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-1ce4c13a-bad8-4f80-ac9d-bf6a664191d5 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:42.680007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1ce4c13a-bad8-4f80-ac9d-bf6a664191d5 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:42.680462 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1ce4c13a-bad8-4f80-ac9d-bf6a664191d5 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:42.681312 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1ce4c13a-bad8-4f80-ac9d-bf6a664191d5 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:42.682037 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1ce4c13a-bad8-4f80-ac9d-bf6a664191d5 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:42.719904 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-fac2bf40-fe12-4a3a-ba26-baf60ed15262 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:42.722819 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-fac2bf40-fe12-4a3a-ba26-baf60ed15262 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:42.735964 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fac2bf40-fe12-4a3a-ba26-baf60ed15262 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:42.736702 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fac2bf40-fe12-4a3a-ba26-baf60ed15262 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:42.738659 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fac2bf40-fe12-4a3a-ba26-baf60ed15262 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:42.739286 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fac2bf40-fe12-4a3a-ba26-baf60ed15262 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:42.826868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1ce4c13a-bad8-4f80-ac9d-bf6a664191d5 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156286 Jul 29 11:50:42.827725 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 268/523] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Jul 29 11:50:42 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:43.007684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fac2bf40-fe12-4a3a-ba26-baf60ed15262 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:43.017793 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fac2bf40-fe12-4a3a-ba26-baf60ed15262 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:43.019430 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fac2bf40-fe12-4a3a-ba26-baf60ed15262 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:43.021595 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-fac2bf40-fe12-4a3a-ba26-baf60ed15262 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1406 microversion: 2.20 time: 0.312167 Jul 29 11:50:43.033976 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 256/524] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:50:42 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:50:43.443475 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-e0cbde32-9f77-4963-b8b3-a9599c205b3f req-4476b6a9-bb32-43e6-b296-cb106bc54445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21b28697-8f3b-4087-ae1b-836eb376d11b", "tag": "d99e2239-1b7e-46f6-b919-e3f8a7ca8642"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:43.456415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-e0cbde32-9f77-4963-b8b3-a9599c205b3f req-4476b6a9-bb32-43e6-b296-cb106bc54445 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:43.457133 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-e0cbde32-9f77-4963-b8b3-a9599c205b3f req-4476b6a9-bb32-43e6-b296-cb106bc54445 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:43.469941 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-e0cbde32-9f77-4963-b8b3-a9599c205b3f req-4476b6a9-bb32-43e6-b296-cb106bc54445 service nova] Creating event network-changed:d99e2239-1b7e-46f6-b919-e3f8a7ca8642 for instance 21b28697-8f3b-4087-ae1b-836eb376d11b on hv-cinder-83754 Jul 29 11:50:43.474988 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-e0cbde32-9f77-4963-b8b3-a9599c205b3f req-4476b6a9-bb32-43e6-b296-cb106bc54445 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035336 Jul 29 11:50:43.476186 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 269/525] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:43.916436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-85849962-8406-4ee8-9a61-5ccdc2c9fdd1 req-1c9b6c59-ddb3-4326-b04e-1d42153426f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "439cbe53-546a-4902-a4e7-c25b4a7b84d0", "tag": "df601806-d30d-4808-ad00-6cb495f89154"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:43.927271 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-85849962-8406-4ee8-9a61-5ccdc2c9fdd1 req-1c9b6c59-ddb3-4326-b04e-1d42153426f7 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:43.927812 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-85849962-8406-4ee8-9a61-5ccdc2c9fdd1 req-1c9b6c59-ddb3-4326-b04e-1d42153426f7 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:43.940624 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-85849962-8406-4ee8-9a61-5ccdc2c9fdd1 req-1c9b6c59-ddb3-4326-b04e-1d42153426f7 service nova] Creating event network-changed:df601806-d30d-4808-ad00-6cb495f89154 for instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 on hv-cinder-83754 Jul 29 11:50:43.945876 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-85849962-8406-4ee8-9a61-5ccdc2c9fdd1 req-1c9b6c59-ddb3-4326-b04e-1d42153426f7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033144 Jul 29 11:50:43.946503 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 257/526] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:50:44.047962 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-94d933d9-57b6-4192-be78-defa21cead5d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:44.048760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-94d933d9-57b6-4192-be78-defa21cead5d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:44.054913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-94d933d9-57b6-4192-be78-defa21cead5d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:44.055372 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-94d933d9-57b6-4192-be78-defa21cead5d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:44.056145 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-94d933d9-57b6-4192-be78-defa21cead5d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:44.056596 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-94d933d9-57b6-4192-be78-defa21cead5d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:44.186265 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-94d933d9-57b6-4192-be78-defa21cead5d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:44.194308 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-94d933d9-57b6-4192-be78-defa21cead5d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:44.195822 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-94d933d9-57b6-4192-be78-defa21cead5d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:44.196941 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-94d933d9-57b6-4192-be78-defa21cead5d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1406 microversion: 2.20 time: 0.153748 Jul 29 11:50:44.197510 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 270/527] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:50:44 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:50:45.219982 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-79763d07-4d36-41a7-851e-720054605b7f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:45.220712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-79763d07-4d36-41a7-851e-720054605b7f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:45.227303 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-79763d07-4d36-41a7-851e-720054605b7f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:45.227759 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-79763d07-4d36-41a7-851e-720054605b7f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:45.228547 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-79763d07-4d36-41a7-851e-720054605b7f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:45.228990 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-79763d07-4d36-41a7-851e-720054605b7f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:45.368567 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-79763d07-4d36-41a7-851e-720054605b7f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:45.377893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-79763d07-4d36-41a7-851e-720054605b7f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:45.379402 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-79763d07-4d36-41a7-851e-720054605b7f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:45.380536 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-79763d07-4d36-41a7-851e-720054605b7f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1406 microversion: 2.20 time: 0.166095 Jul 29 11:50:45.381114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 258/528] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:50:45 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:50:46.404786 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-25d27c91-601d-4b0c-a4c5-623abeef90ad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:46.405527 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-25d27c91-601d-4b0c-a4c5-623abeef90ad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:46.412430 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-25d27c91-601d-4b0c-a4c5-623abeef90ad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:46.412886 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-25d27c91-601d-4b0c-a4c5-623abeef90ad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:46.413694 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-25d27c91-601d-4b0c-a4c5-623abeef90ad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:46.414139 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-25d27c91-601d-4b0c-a4c5-623abeef90ad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:46.548817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-25d27c91-601d-4b0c-a4c5-623abeef90ad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:46.557532 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-25d27c91-601d-4b0c-a4c5-623abeef90ad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:46.559766 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-25d27c91-601d-4b0c-a4c5-623abeef90ad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:46.560975 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-25d27c91-601d-4b0c-a4c5-623abeef90ad tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1406 microversion: 2.20 time: 0.160373 Jul 29 11:50:46.561566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 271/529] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:50:46 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:50:47.584903 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-41fc4d4a-60a9-4bdb-ab7a-d80ff7e7e574 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:47.586571 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-41fc4d4a-60a9-4bdb-ab7a-d80ff7e7e574 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:47.594635 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-41fc4d4a-60a9-4bdb-ab7a-d80ff7e7e574 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:47.595324 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-41fc4d4a-60a9-4bdb-ab7a-d80ff7e7e574 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:47.596124 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-41fc4d4a-60a9-4bdb-ab7a-d80ff7e7e574 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:47.596553 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-41fc4d4a-60a9-4bdb-ab7a-d80ff7e7e574 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:47.712241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-cbe9c291-9a2f-4f77-a0ac-ddb117137e45 req-c0e845b9-ed6c-4baa-932f-cc83236ba857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b28697-8f3b-4087-ae1b-836eb376d11b", "name": "network-vif-plugged", "status": "completed", "tag": "d99e2239-1b7e-46f6-b919-e3f8a7ca8642"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:47.724641 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-cbe9c291-9a2f-4f77-a0ac-ddb117137e45 req-c0e845b9-ed6c-4baa-932f-cc83236ba857 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:47.724989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-cbe9c291-9a2f-4f77-a0ac-ddb117137e45 req-c0e845b9-ed6c-4baa-932f-cc83236ba857 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:47.736403 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-cbe9c291-9a2f-4f77-a0ac-ddb117137e45 req-c0e845b9-ed6c-4baa-932f-cc83236ba857 service nova] Creating event network-vif-plugged:d99e2239-1b7e-46f6-b919-e3f8a7ca8642 for instance 21b28697-8f3b-4087-ae1b-836eb376d11b on hv-cinder-83754 Jul 29 11:50:47.741361 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-cbe9c291-9a2f-4f77-a0ac-ddb117137e45 req-c0e845b9-ed6c-4baa-932f-cc83236ba857 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032635 Jul 29 11:50:47.741931 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 272/530] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:50:47.843405 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-41fc4d4a-60a9-4bdb-ab7a-d80ff7e7e574 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:47.851645 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-41fc4d4a-60a9-4bdb-ab7a-d80ff7e7e574 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:47.853400 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-41fc4d4a-60a9-4bdb-ab7a-d80ff7e7e574 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:47.854579 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-41fc4d4a-60a9-4bdb-ab7a-d80ff7e7e574 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1406 microversion: 2.20 time: 0.274741 Jul 29 11:50:47.855519 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 259/531] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:50:47 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:50:48.879649 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-2e37e469-723a-4864-b4fb-6bb84bf1e43c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:48.880789 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-2e37e469-723a-4864-b4fb-6bb84bf1e43c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:48.888169 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2e37e469-723a-4864-b4fb-6bb84bf1e43c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:48.888910 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2e37e469-723a-4864-b4fb-6bb84bf1e43c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:48.890406 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2e37e469-723a-4864-b4fb-6bb84bf1e43c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:48.891089 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2e37e469-723a-4864-b4fb-6bb84bf1e43c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:49.170814 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2e37e469-723a-4864-b4fb-6bb84bf1e43c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:49.179231 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2e37e469-723a-4864-b4fb-6bb84bf1e43c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:49.180743 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2e37e469-723a-4864-b4fb-6bb84bf1e43c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:49.181898 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-2e37e469-723a-4864-b4fb-6bb84bf1e43c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1406 microversion: 2.20 time: 0.307024 Jul 29 11:50:49.182455 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 273/532] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:50:48 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:50:50.205023 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-0bd27eec-7cac-4e9e-ad44-9275fc189cb8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:50.205819 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-0bd27eec-7cac-4e9e-ad44-9275fc189cb8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:50.212515 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0bd27eec-7cac-4e9e-ad44-9275fc189cb8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:50.212970 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0bd27eec-7cac-4e9e-ad44-9275fc189cb8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:50.214062 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0bd27eec-7cac-4e9e-ad44-9275fc189cb8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:50.214565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0bd27eec-7cac-4e9e-ad44-9275fc189cb8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:50.435496 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:50.439097 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-0bd27eec-7cac-4e9e-ad44-9275fc189cb8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:50.447428 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-0bd27eec-7cac-4e9e-ad44-9275fc189cb8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:50.448926 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-0bd27eec-7cac-4e9e-ad44-9275fc189cb8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:50:50.450513 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-0bd27eec-7cac-4e9e-ad44-9275fc189cb8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1599 microversion: 2.20 time: 0.249614 Jul 29 11:50:50.451320 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 260/533] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:50:50 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1599 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:50:50.474721 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d3657dd3-5716-4acf-bdc7-3e7db5489647 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:50:50.475211 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d3657dd3-5716-4acf-bdc7-3e7db5489647 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:50:50.482577 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d3657dd3-5716-4acf-bdc7-3e7db5489647 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:50.483317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d3657dd3-5716-4acf-bdc7-3e7db5489647 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:50.484297 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d3657dd3-5716-4acf-bdc7-3e7db5489647 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:50.485200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d3657dd3-5716-4acf-bdc7-3e7db5489647 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:50.578628 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=6 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:50.603476 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d3657dd3-5716-4acf-bdc7-3e7db5489647 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.133442 Jul 29 11:50:50.604430 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 274/534] 10.222.0.60 () {60 vars in 1316 bytes} [Fri Jul 29 11:50:50 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 11:50:52.456201 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-6f6ed1b0-7428-4f24-9b7a-3704fcfc0a98 req-12cdf63d-fc1a-4c12-b916-045b2ddc850f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21b28697-8f3b-4087-ae1b-836eb376d11b", "tag": "d99e2239-1b7e-46f6-b919-e3f8a7ca8642"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:50:52.461378 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=6 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:50:52.469251 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-6f6ed1b0-7428-4f24-9b7a-3704fcfc0a98 req-12cdf63d-fc1a-4c12-b916-045b2ddc850f service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:50:52.469721 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-6f6ed1b0-7428-4f24-9b7a-3704fcfc0a98 req-12cdf63d-fc1a-4c12-b916-045b2ddc850f service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:50:52.484592 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-6f6ed1b0-7428-4f24-9b7a-3704fcfc0a98 req-12cdf63d-fc1a-4c12-b916-045b2ddc850f service nova] Creating event network-changed:d99e2239-1b7e-46f6-b919-e3f8a7ca8642 for instance 21b28697-8f3b-4087-ae1b-836eb376d11b on hv-cinder-83754 Jul 29 11:50:52.490074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-6f6ed1b0-7428-4f24-9b7a-3704fcfc0a98 req-12cdf63d-fc1a-4c12-b916-045b2ddc850f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039497 Jul 29 11:50:52.490889 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 261/535] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:02.590164 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:02.592180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=41 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:02.597784 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1304f94f-322b-47ea-9f80-b353247498e6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:02.598546 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-1304f94f-322b-47ea-9f80-b353247498e6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:02.607574 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1304f94f-322b-47ea-9f80-b353247498e6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:02.608261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1304f94f-322b-47ea-9f80-b353247498e6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:02.609268 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1304f94f-322b-47ea-9f80-b353247498e6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:02.609928 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1304f94f-322b-47ea-9f80-b353247498e6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:02.703302 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-1304f94f-322b-47ea-9f80-b353247498e6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lazy-loading 'services' on Instance uuid 51b4f838-c329-43d2-8448-82ad1ee8ad2a {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:51:02.792404 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1304f94f-322b-47ea-9f80-b353247498e6 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "DELETE /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/os-volume_attachments/5c877b70-645e-404e-92b9-880786582e41" status: 202 len: 0 microversion: 2.1 time: 0.203401 Jul 29 11:51:02.793958 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 275/536] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Jul 29 11:51:02 2022] DELETE /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/os-volume_attachments/5c877b70-645e-404e-92b9-880786582e41 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:51:02.800479 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=66,nova_api:DELETE=1 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:02.800979 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=85 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:02.810919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8e062a57-5c4e-4463-a74e-fea78ca22a35 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:02.813236 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8e062a57-5c4e-4463-a74e-fea78ca22a35 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:02.820975 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8e062a57-5c4e-4463-a74e-fea78ca22a35 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:02.821736 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8e062a57-5c4e-4463-a74e-fea78ca22a35 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:02.822578 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8e062a57-5c4e-4463-a74e-fea78ca22a35 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:02.823027 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8e062a57-5c4e-4463-a74e-fea78ca22a35 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:02.869980 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8e062a57-5c4e-4463-a74e-fea78ca22a35 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071291 Jul 29 11:51:02.875635 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 262/537] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:51:02 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:03.884811 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-25c7fe58-02cd-4424-8a24-7527ba86d2ef tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:03.887602 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-25c7fe58-02cd-4424-8a24-7527ba86d2ef tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:03.894845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-25c7fe58-02cd-4424-8a24-7527ba86d2ef tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:03.895301 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-25c7fe58-02cd-4424-8a24-7527ba86d2ef tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:03.896079 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-25c7fe58-02cd-4424-8a24-7527ba86d2ef tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:03.896516 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-25c7fe58-02cd-4424-8a24-7527ba86d2ef tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:03.928723 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-25c7fe58-02cd-4424-8a24-7527ba86d2ef tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049096 Jul 29 11:51:03.929477 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 276/538] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:51:03 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 11:51:04.008901 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-3b8dc584-f459-4d30-9a6c-637c618342bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:04.009906 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-3b8dc584-f459-4d30-9a6c-637c618342bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:04.020716 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3b8dc584-f459-4d30-9a6c-637c618342bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:04.021323 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3b8dc584-f459-4d30-9a6c-637c618342bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:04.022263 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3b8dc584-f459-4d30-9a6c-637c618342bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:04.022852 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3b8dc584-f459-4d30-9a6c-637c618342bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:04.052846 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-3b8dc584-f459-4d30-9a6c-637c618342bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Going to try to terminate instance {{(pid=129585) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:51:04.141284 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-3b8dc584-f459-4d30-9a6c-637c618342bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "DELETE /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 204 len: 0 microversion: 2.1 time: 0.136524 Jul 29 11:51:04.143272 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 263/539] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:51:04 2022] DELETE /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:51:04.151832 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d21f85a1-fe61-44c2-922e-aef6e36df517 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:04.153391 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d21f85a1-fe61-44c2-922e-aef6e36df517 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:04.161113 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d21f85a1-fe61-44c2-922e-aef6e36df517 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:04.161945 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d21f85a1-fe61-44c2-922e-aef6e36df517 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:04.163198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d21f85a1-fe61-44c2-922e-aef6e36df517 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:04.163863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d21f85a1-fe61-44c2-922e-aef6e36df517 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:04.315215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d21f85a1-fe61-44c2-922e-aef6e36df517 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:04.323220 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d21f85a1-fe61-44c2-922e-aef6e36df517 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1689 microversion: 2.1 time: 0.175738 Jul 29 11:51:04.326448 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 277/540] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:04 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:05.346782 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9a701362-5261-4c66-a722-75ab93772316 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:05.347474 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9a701362-5261-4c66-a722-75ab93772316 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:05.353960 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9a701362-5261-4c66-a722-75ab93772316 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:05.354692 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9a701362-5261-4c66-a722-75ab93772316 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:05.355777 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9a701362-5261-4c66-a722-75ab93772316 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:05.356774 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9a701362-5261-4c66-a722-75ab93772316 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:05.504356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9a701362-5261-4c66-a722-75ab93772316 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:05.512850 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9a701362-5261-4c66-a722-75ab93772316 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1689 microversion: 2.1 time: 0.170276 Jul 29 11:51:05.513875 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 264/541] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:05 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:06.526122 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-24fb5c49-9856-4c1d-b37d-17aafb85dd71 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Action: 'create', calling method: .version_select at 0x7f68fa0c4670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-263033650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9S+Olop5F+hXGG64HxxMK88E7T53tH2sV6G5Fm+MwoP+ZR0uNkfYPD+fjnq0C7ZNK9775R0qaQU+ZSctPAqfdf+wrDGxXkURcK98fB2VPFPuwupeRmNjMQJex/AxbW1A=="}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:06.533755 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-d6b2e7a2-91e7-4b17-8f9f-627b48f62639 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:06.534439 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-d6b2e7a2-91e7-4b17-8f9f-627b48f62639 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:06.541093 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d6b2e7a2-91e7-4b17-8f9f-627b48f62639 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:06.541585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d6b2e7a2-91e7-4b17-8f9f-627b48f62639 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:06.542361 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d6b2e7a2-91e7-4b17-8f9f-627b48f62639 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:06.543098 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-24fb5c49-9856-4c1d-b37d-17aafb85dd71 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Getting quotas for project 861c5a0403c94abd9ae479175604c835. Resources: {'key_pairs'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:51:06.543389 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d6b2e7a2-91e7-4b17-8f9f-627b48f62639 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:06.547181 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-24fb5c49-9856-4c1d-b37d-17aafb85dd71 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Getting quotas for user 5c56880b1a64449e8e0de42174222600 and project 861c5a0403c94abd9ae479175604c835. Resources: {'key_pairs'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:51:06.568753 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-24fb5c49-9856-4c1d-b37d-17aafb85dd71 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046506 Jul 29 11:51:06.569345 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 278/542] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Jul 29 11:51:06 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:06.620397 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9f8c102f-d9d3-4580-b388-e042df53d9c4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1161120323", "imageRef": "bea058ff-327d-4b33-9c62-68b975e0a0bd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-263033650", "networks": [{"uuid": "4b7a423e-a1dd-4f39-aa4f-d5ecfe054eb6"}]}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:06.675773 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.network.neutron [None req-9f8c102f-d9d3-4580-b388-e042df53d9c4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] validate_networks() for [('4b7a423e-a1dd-4f39-aa4f-d5ecfe054eb6', None, None, None, None, None)] {{(pid=129584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:51:06.676611 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-d6b2e7a2-91e7-4b17-8f9f-627b48f62639 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:06.684868 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-d6b2e7a2-91e7-4b17-8f9f-627b48f62639 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1689 microversion: 2.1 time: 0.154858 Jul 29 11:51:06.685454 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 265/543] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:06 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:51:07.040254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-9f8c102f-d9d3-4580-b388-e042df53d9c4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Flavor limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:51:07.040683 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-9f8c102f-d9d3-4580-b388-e042df53d9c4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Image limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:51:07.041161 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-9f8c102f-d9d3-4580-b388-e042df53d9c4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Flavor pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:51:07.041621 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-9f8c102f-d9d3-4580-b388-e042df53d9c4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Image pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:51:07.042037 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-9f8c102f-d9d3-4580-b388-e042df53d9c4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:51:07.051405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9f8c102f-d9d3-4580-b388-e042df53d9c4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:07.051851 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9f8c102f-d9d3-4580-b388-e042df53d9c4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:07.052644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9f8c102f-d9d3-4580-b388-e042df53d9c4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:07.053081 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9f8c102f-d9d3-4580-b388-e042df53d9c4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:07.069396 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-9f8c102f-d9d3-4580-b388-e042df53d9c4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Getting quotas for project 861c5a0403c94abd9ae479175604c835. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:51:07.073368 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-9f8c102f-d9d3-4580-b388-e042df53d9c4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Getting quotas for user 5c56880b1a64449e8e0de42174222600 and project 861c5a0403c94abd9ae479175604c835. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:51:07.084336 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-9f8c102f-d9d3-4580-b388-e042df53d9c4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Going to run 1 instances... {{(pid=129584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:51:07.086541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-9f8c102f-d9d3-4580-b388-e042df53d9c4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bea058ff-327d-4b33-9c62-68b975e0a0bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:51:07.131443 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-9f8c102f-d9d3-4580-b388-e042df53d9c4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514966 Jul 29 11:51:07.132080 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 279/544] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 11:51:07.143856 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-65879b97-ee2e-49e0-afe6-72737f1b052d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:07.144500 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-65879b97-ee2e-49e0-afe6-72737f1b052d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:07.198390 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-65879b97-ee2e-49e0-afe6-72737f1b052d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:07.205190 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-65879b97-ee2e-49e0-afe6-72737f1b052d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1258 microversion: 2.1 time: 0.065212 Jul 29 11:51:07.206418 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 266/545] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:07 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:07.706225 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-17e74c78-7ca6-41ae-b289-c53e593a1f04 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:07.706742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-17e74c78-7ca6-41ae-b289-c53e593a1f04 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:07.713467 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-17e74c78-7ca6-41ae-b289-c53e593a1f04 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:07.713922 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-17e74c78-7ca6-41ae-b289-c53e593a1f04 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:07.715252 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-17e74c78-7ca6-41ae-b289-c53e593a1f04 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:07.715683 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-17e74c78-7ca6-41ae-b289-c53e593a1f04 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:07.851168 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-17e74c78-7ca6-41ae-b289-c53e593a1f04 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:07.858713 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-17e74c78-7ca6-41ae-b289-c53e593a1f04 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1689 microversion: 2.1 time: 0.156942 Jul 29 11:51:07.859281 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 280/546] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:07 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:51:08.226770 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-cc3fe04a-a958-4ce3-a111-999603cf18d7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:08.227422 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-cc3fe04a-a958-4ce3-a111-999603cf18d7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:08.234621 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cc3fe04a-a958-4ce3-a111-999603cf18d7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:08.235074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cc3fe04a-a958-4ce3-a111-999603cf18d7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:08.235847 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cc3fe04a-a958-4ce3-a111-999603cf18d7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:08.236339 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cc3fe04a-a958-4ce3-a111-999603cf18d7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:08.298371 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-cc3fe04a-a958-4ce3-a111-999603cf18d7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:08.307834 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-cc3fe04a-a958-4ce3-a111-999603cf18d7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1310 microversion: 2.1 time: 0.084894 Jul 29 11:51:08.308449 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 267/547] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:08 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:08.888804 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-48a409ac-2a1d-467f-bd9f-74c26ba15344 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:08.890197 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-48a409ac-2a1d-467f-bd9f-74c26ba15344 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:08.899462 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-48a409ac-2a1d-467f-bd9f-74c26ba15344 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:08.900324 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-48a409ac-2a1d-467f-bd9f-74c26ba15344 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:08.901483 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-48a409ac-2a1d-467f-bd9f-74c26ba15344 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:08.902464 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-48a409ac-2a1d-467f-bd9f-74c26ba15344 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:09.128608 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-48a409ac-2a1d-467f-bd9f-74c26ba15344 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:09.139142 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-48a409ac-2a1d-467f-bd9f-74c26ba15344 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1689 microversion: 2.1 time: 0.259114 Jul 29 11:51:09.154230 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 281/548] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:08 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1689 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:09.332187 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-346a9163-ebb4-460d-aed8-cb8d164b36f9 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:09.333681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-346a9163-ebb4-460d-aed8-cb8d164b36f9 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:09.350048 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-346a9163-ebb4-460d-aed8-cb8d164b36f9 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:09.350912 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-346a9163-ebb4-460d-aed8-cb8d164b36f9 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:09.351704 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-346a9163-ebb4-460d-aed8-cb8d164b36f9 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:09.352167 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-346a9163-ebb4-460d-aed8-cb8d164b36f9 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:09.426039 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-346a9163-ebb4-460d-aed8-cb8d164b36f9 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:09.434743 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-346a9163-ebb4-460d-aed8-cb8d164b36f9 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1316 microversion: 2.1 time: 0.107438 Jul 29 11:51:09.435673 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 268/549] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:09 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1316 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:09.646699 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-9766435f-8a23-4a44-bf6f-2540242373a8 req-33f4d555-0454-48c9-bf2f-f1bc04c6670e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b4f838-c329-43d2-8448-82ad1ee8ad2a", "name": "network-vif-deleted", "tag": "666ba69f-5b53-402b-9db5-8013b146c1da"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:09.658129 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-9766435f-8a23-4a44-bf6f-2540242373a8 req-33f4d555-0454-48c9-bf2f-f1bc04c6670e service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:09.658682 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-9766435f-8a23-4a44-bf6f-2540242373a8 req-33f4d555-0454-48c9-bf2f-f1bc04c6670e service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:09.672295 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-9766435f-8a23-4a44-bf6f-2540242373a8 req-33f4d555-0454-48c9-bf2f-f1bc04c6670e service nova] Creating event network-vif-deleted:666ba69f-5b53-402b-9db5-8013b146c1da for instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a on hv-cinder-83754 Jul 29 11:51:09.687957 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-9766435f-8a23-4a44-bf6f-2540242373a8 req-33f4d555-0454-48c9-bf2f-f1bc04c6670e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045101 Jul 29 11:51:09.692115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 282/550] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:10.161368 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-012c2467-b153-4a09-9a5b-1d08a1fe6296 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:10.162810 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-012c2467-b153-4a09-9a5b-1d08a1fe6296 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:10.169548 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-012c2467-b153-4a09-9a5b-1d08a1fe6296 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:10.170003 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-012c2467-b153-4a09-9a5b-1d08a1fe6296 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:10.171035 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-012c2467-b153-4a09-9a5b-1d08a1fe6296 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:10.171480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-012c2467-b153-4a09-9a5b-1d08a1fe6296 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:10.266586 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-012c2467-b153-4a09-9a5b-1d08a1fe6296 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:10.275684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-012c2467-b153-4a09-9a5b-1d08a1fe6296 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1622 microversion: 2.1 time: 0.118091 Jul 29 11:51:10.282027 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 269/551] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:10 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1622 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:10.457350 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-a2558040-f8a2-4b61-b636-099ba28c44d1 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:10.459463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-a2558040-f8a2-4b61-b636-099ba28c44d1 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:10.466531 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a2558040-f8a2-4b61-b636-099ba28c44d1 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:10.467053 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a2558040-f8a2-4b61-b636-099ba28c44d1 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:10.468014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a2558040-f8a2-4b61-b636-099ba28c44d1 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:10.469018 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a2558040-f8a2-4b61-b636-099ba28c44d1 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:10.554664 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a2558040-f8a2-4b61-b636-099ba28c44d1 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:10.563870 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-a2558040-f8a2-4b61-b636-099ba28c44d1 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1316 microversion: 2.1 time: 0.111438 Jul 29 11:51:10.565532 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 283/552] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:10 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1316 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:11.300563 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9d89b96c-5269-4c7e-adff-7de60c3f2443 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:11.301092 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9d89b96c-5269-4c7e-adff-7de60c3f2443 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:11.307319 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d89b96c-5269-4c7e-adff-7de60c3f2443 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:11.307776 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d89b96c-5269-4c7e-adff-7de60c3f2443 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:11.309171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d89b96c-5269-4c7e-adff-7de60c3f2443 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:11.309637 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9d89b96c-5269-4c7e-adff-7de60c3f2443 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:11.376277 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9d89b96c-5269-4c7e-adff-7de60c3f2443 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:11.383988 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9d89b96c-5269-4c7e-adff-7de60c3f2443 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1622 microversion: 2.1 time: 0.087555 Jul 29 11:51:11.384561 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 270/553] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:11 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1622 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:51:11.585445 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c65f9123-f0ec-44d5-8914-aff4059c2371 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:11.586061 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c65f9123-f0ec-44d5-8914-aff4059c2371 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:11.593513 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c65f9123-f0ec-44d5-8914-aff4059c2371 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:11.593975 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c65f9123-f0ec-44d5-8914-aff4059c2371 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:11.594759 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c65f9123-f0ec-44d5-8914-aff4059c2371 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:11.595194 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c65f9123-f0ec-44d5-8914-aff4059c2371 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:11.913197 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c65f9123-f0ec-44d5-8914-aff4059c2371 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:11.921786 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c65f9123-f0ec-44d5-8914-aff4059c2371 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1316 microversion: 2.1 time: 0.340081 Jul 29 11:51:11.922746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 284/554] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:11 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:12.406835 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ff23bc42-5b86-48bc-ab12-9a361f47e759 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:12.407674 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ff23bc42-5b86-48bc-ab12-9a361f47e759 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:12.414440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ff23bc42-5b86-48bc-ab12-9a361f47e759 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:12.414974 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ff23bc42-5b86-48bc-ab12-9a361f47e759 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:12.415828 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ff23bc42-5b86-48bc-ab12-9a361f47e759 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:12.416365 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ff23bc42-5b86-48bc-ab12-9a361f47e759 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:12.481390 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ff23bc42-5b86-48bc-ab12-9a361f47e759 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:12.489302 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ff23bc42-5b86-48bc-ab12-9a361f47e759 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1622 microversion: 2.1 time: 0.086498 Jul 29 11:51:12.490182 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 271/555] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:12 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1622 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:12.943257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-0eaf694e-3461-41e6-bd1a-3c386fafac76 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:12.943938 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-0eaf694e-3461-41e6-bd1a-3c386fafac76 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:12.952325 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0eaf694e-3461-41e6-bd1a-3c386fafac76 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:12.952777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0eaf694e-3461-41e6-bd1a-3c386fafac76 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:12.953583 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0eaf694e-3461-41e6-bd1a-3c386fafac76 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:12.954023 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0eaf694e-3461-41e6-bd1a-3c386fafac76 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:13.017804 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-0eaf694e-3461-41e6-bd1a-3c386fafac76 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:13.025375 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-0eaf694e-3461-41e6-bd1a-3c386fafac76 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1316 microversion: 2.1 time: 0.086257 Jul 29 11:51:13.026219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 285/556] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:12 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1316 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:51:13.513633 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c7f71756-451d-4de3-8595-6a8a652fa497 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:13.514257 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-c7f71756-451d-4de3-8595-6a8a652fa497 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:13.520926 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c7f71756-451d-4de3-8595-6a8a652fa497 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:13.521382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c7f71756-451d-4de3-8595-6a8a652fa497 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:13.522194 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c7f71756-451d-4de3-8595-6a8a652fa497 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:13.522637 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c7f71756-451d-4de3-8595-6a8a652fa497 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:13.596134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-c7f71756-451d-4de3-8595-6a8a652fa497 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:13.604045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-c7f71756-451d-4de3-8595-6a8a652fa497 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1622 microversion: 2.1 time: 0.095508 Jul 29 11:51:13.605647 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 272/557] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:13 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1622 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:14.046990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-817bea30-4674-4836-90fe-e1d198f306a8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:14.047709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-817bea30-4674-4836-90fe-e1d198f306a8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:14.054567 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-817bea30-4674-4836-90fe-e1d198f306a8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:14.055155 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-817bea30-4674-4836-90fe-e1d198f306a8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:14.056019 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-817bea30-4674-4836-90fe-e1d198f306a8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:14.056532 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-817bea30-4674-4836-90fe-e1d198f306a8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:14.126419 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-817bea30-4674-4836-90fe-e1d198f306a8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:14.134259 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-817bea30-4674-4836-90fe-e1d198f306a8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1316 microversion: 2.1 time: 0.091818 Jul 29 11:51:14.135055 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 286/558] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:14 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1316 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:14.626555 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-1947900a-0f4d-4aa6-93f3-04c796e8b282 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:14.627204 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-1947900a-0f4d-4aa6-93f3-04c796e8b282 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:14.634267 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1947900a-0f4d-4aa6-93f3-04c796e8b282 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:14.634811 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1947900a-0f4d-4aa6-93f3-04c796e8b282 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:14.636502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1947900a-0f4d-4aa6-93f3-04c796e8b282 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:14.637196 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1947900a-0f4d-4aa6-93f3-04c796e8b282 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:14.703815 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-1947900a-0f4d-4aa6-93f3-04c796e8b282 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:14.712156 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-1947900a-0f4d-4aa6-93f3-04c796e8b282 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1622 microversion: 2.1 time: 0.089489 Jul 29 11:51:14.712954 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 273/559] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:14 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1622 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:15.156603 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-8d002f24-118f-4362-b7be-cc1bec24b028 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:15.157517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-8d002f24-118f-4362-b7be-cc1bec24b028 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:15.164261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8d002f24-118f-4362-b7be-cc1bec24b028 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:15.164718 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8d002f24-118f-4362-b7be-cc1bec24b028 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:15.165510 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8d002f24-118f-4362-b7be-cc1bec24b028 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:15.165951 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8d002f24-118f-4362-b7be-cc1bec24b028 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:15.234026 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-8d002f24-118f-4362-b7be-cc1bec24b028 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:15.242457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-8d002f24-118f-4362-b7be-cc1bec24b028 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1316 microversion: 2.1 time: 0.089778 Jul 29 11:51:15.243031 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 287/560] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:15 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1316 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:15.734570 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-16dca24b-238b-4a23-a3d9-4c9ac3066060 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:15.735273 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-16dca24b-238b-4a23-a3d9-4c9ac3066060 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:15.742439 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-16dca24b-238b-4a23-a3d9-4c9ac3066060 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:15.742901 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-16dca24b-238b-4a23-a3d9-4c9ac3066060 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:15.743695 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-16dca24b-238b-4a23-a3d9-4c9ac3066060 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:15.744137 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-16dca24b-238b-4a23-a3d9-4c9ac3066060 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:15.808968 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-16dca24b-238b-4a23-a3d9-4c9ac3066060 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:15.817006 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-16dca24b-238b-4a23-a3d9-4c9ac3066060 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1622 microversion: 2.1 time: 0.087317 Jul 29 11:51:15.817664 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 274/561] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:15 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1622 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:16.264345 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d915a107-c658-4472-8bbd-d461da4745d4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:16.265719 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d915a107-c658-4472-8bbd-d461da4745d4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:16.272749 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d915a107-c658-4472-8bbd-d461da4745d4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:16.273339 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d915a107-c658-4472-8bbd-d461da4745d4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:16.274505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d915a107-c658-4472-8bbd-d461da4745d4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:16.275029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d915a107-c658-4472-8bbd-d461da4745d4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:16.342735 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d915a107-c658-4472-8bbd-d461da4745d4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:16.350581 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d915a107-c658-4472-8bbd-d461da4745d4 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1316 microversion: 2.1 time: 0.090913 Jul 29 11:51:16.351276 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 288/562] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:16 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1316 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:16.838246 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-325e8fc9-3990-4272-b791-26c248abc218 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:16.838814 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-325e8fc9-3990-4272-b791-26c248abc218 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:16.845362 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-325e8fc9-3990-4272-b791-26c248abc218 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:16.845857 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-325e8fc9-3990-4272-b791-26c248abc218 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:16.846630 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-325e8fc9-3990-4272-b791-26c248abc218 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:16.847071 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-325e8fc9-3990-4272-b791-26c248abc218 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:16.910741 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-325e8fc9-3990-4272-b791-26c248abc218 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:16.918377 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-325e8fc9-3990-4272-b791-26c248abc218 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 200 len: 1622 microversion: 2.1 time: 0.084080 Jul 29 11:51:16.918948 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 275/563] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:16 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 1622 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:17.372767 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d0d90d47-24e3-4408-9c10-e7683fd7abac tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:17.373509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d0d90d47-24e3-4408-9c10-e7683fd7abac tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:17.375816 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=2 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:17.376559 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=10 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:17.383359 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d0d90d47-24e3-4408-9c10-e7683fd7abac tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:17.383898 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d0d90d47-24e3-4408-9c10-e7683fd7abac tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:17.384786 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d0d90d47-24e3-4408-9c10-e7683fd7abac tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:17.385638 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d0d90d47-24e3-4408-9c10-e7683fd7abac tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:17.448815 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d0d90d47-24e3-4408-9c10-e7683fd7abac tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:17.456259 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d0d90d47-24e3-4408-9c10-e7683fd7abac tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1316 microversion: 2.1 time: 0.087774 Jul 29 11:51:17.456837 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 289/564] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:17 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1316 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:17.939945 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-bad0a632-7293-454e-b0eb-6f1231f915bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:17.940585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-bad0a632-7293-454e-b0eb-6f1231f915bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 51b4f838-c329-43d2-8448-82ad1ee8ad2a] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:17.942627 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:17.949156 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bad0a632-7293-454e-b0eb-6f1231f915bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:17.949662 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bad0a632-7293-454e-b0eb-6f1231f915bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:17.950428 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bad0a632-7293-454e-b0eb-6f1231f915bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:17.950909 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bad0a632-7293-454e-b0eb-6f1231f915bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:17.965845 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-bad0a632-7293-454e-b0eb-6f1231f915bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] HTTP exception thrown: Instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a could not be found. Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-bad0a632-7293-454e-b0eb-6f1231f915bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Request method failure captured: Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a HTTP/1.1 Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48icWNF5VduBTIvjMx74oGekPjDM_WyPKfDFEqTnYbP9pmMYJ3iVEIhDcbFTI1aIEBtbuMVZ512qIJ9lmpywo_t0j8JU4KEV9fFpkjZDe9V6y8DrRt8ODhPkRG0qurIOC8MLkMcQJ5L6wWkf-02BMuHwG4Gsjsp_xiI86N4-AN7FChY Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 106664c99e9c4a0d9a9c9c05e08a3d7f Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1574150610 Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:51:17.967495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:51:17.969065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/106664c99e9c4a0d9a9c9c05e08a3d7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_106664c99e9c4a0d9a9c9c05e08a3d7f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/106664c99e9c4a0d9a9c9c05e08a3d7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/106664c99e9c4a0d9a9c9c05e08a3d7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:51:17.969065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1574150610 Jul 29 11:51:17.969065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 106664c99e9c4a0d9a9c9c05e08a3d7f Jul 29 11:51:17.969065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1574150610 Jul 29 11:51:17.969065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-ServerRescueNegativeTestJSON-1574150610-project Jul 29 11:51:17.969065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:51:17.969065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:51:17.969065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 9d341bba8dda445ca4eac6d52aa9f80c Jul 29 11:51:17.969065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1574150610-project Jul 29 11:51:17.969065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:51:17.969065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a could not be found. Jul 29 11:51:17.969065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': '51b4f838-c329-43d2-8448-82ad1ee8ad2a'} Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a could not be found. Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:51:17.969894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a could not be found. Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a could not be found. Jul 29 11:51:17.971095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:51:17.973547 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-bad0a632-7293-454e-b0eb-6f1231f915bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Returning 404 to user: Instance 51b4f838-c329-43d2-8448-82ad1ee8ad2a could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:51:17.974360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-bad0a632-7293-454e-b0eb-6f1231f915bf tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a" status: 404 len: 111 microversion: 2.1 time: 0.038541 Jul 29 11:51:17.974919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 276/565] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:17 2022] GET /compute/v2.1/servers/51b4f838-c329-43d2-8448-82ad1ee8ad2a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:51:17.983697 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9ae9995b-5e5c-4fd8-b96f-e0c4b0553259 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '.version_select at 0x7f68f9f9b430>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:18.003221 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-9ae9995b-5e5c-4fd8-b96f-e0c4b0553259 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1174795307" status: 202 len: 0 microversion: 2.1 time: 0.023737 Jul 29 11:51:18.003788 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 290/566] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Jul 29 11:51:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1174795307 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:51:18.441918 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-8cb4e97e-2173-45eb-bdad-4f520130cf4b req-57ca024e-78b7-483d-bacc-d0e36f737634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f49b2279-4842-4a6c-8dc4-c3429b36f44b", "tag": "60afe5bb-47c8-40c1-8b64-67d4e2f7c626"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:18.467106 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-8cb4e97e-2173-45eb-bdad-4f520130cf4b req-57ca024e-78b7-483d-bacc-d0e36f737634 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:18.472983 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-8cb4e97e-2173-45eb-bdad-4f520130cf4b req-57ca024e-78b7-483d-bacc-d0e36f737634 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:18.479245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-50c6eebe-1d9a-4280-bb15-0f8774f0d378 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:18.481580 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-50c6eebe-1d9a-4280-bb15-0f8774f0d378 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:18.490161 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-8cb4e97e-2173-45eb-bdad-4f520130cf4b req-57ca024e-78b7-483d-bacc-d0e36f737634 service nova] Creating event network-changed:60afe5bb-47c8-40c1-8b64-67d4e2f7c626 for instance f49b2279-4842-4a6c-8dc4-c3429b36f44b on hv-cinder-83754 Jul 29 11:51:18.490439 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-50c6eebe-1d9a-4280-bb15-0f8774f0d378 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:18.491076 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-50c6eebe-1d9a-4280-bb15-0f8774f0d378 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:18.492042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-50c6eebe-1d9a-4280-bb15-0f8774f0d378 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:18.492813 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-50c6eebe-1d9a-4280-bb15-0f8774f0d378 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:18.502648 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-8cb4e97e-2173-45eb-bdad-4f520130cf4b req-57ca024e-78b7-483d-bacc-d0e36f737634 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067797 Jul 29 11:51:18.504006 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 277/567] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:18.736524 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-50c6eebe-1d9a-4280-bb15-0f8774f0d378 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:18.747046 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-50c6eebe-1d9a-4280-bb15-0f8774f0d378 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1358 microversion: 2.1 time: 0.273830 Jul 29 11:51:18.747738 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 291/568] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:18 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:19.769115 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c0a51204-cd8b-40d4-a385-44810e68fda8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:19.769848 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-c0a51204-cd8b-40d4-a385-44810e68fda8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:19.775995 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c0a51204-cd8b-40d4-a385-44810e68fda8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:19.776661 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c0a51204-cd8b-40d4-a385-44810e68fda8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:19.777446 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c0a51204-cd8b-40d4-a385-44810e68fda8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:19.777946 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c0a51204-cd8b-40d4-a385-44810e68fda8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:20.090937 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-c0a51204-cd8b-40d4-a385-44810e68fda8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:20.098616 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-c0a51204-cd8b-40d4-a385-44810e68fda8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1358 microversion: 2.1 time: 0.334114 Jul 29 11:51:20.099284 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 278/569] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:19 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1358 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:21.036454 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-a0bbfad7-7a54-4d0a-95e5-9dae41709727 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:21.037004 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-a0bbfad7-7a54-4d0a-95e5-9dae41709727 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:21.043615 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a0bbfad7-7a54-4d0a-95e5-9dae41709727 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:21.044063 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a0bbfad7-7a54-4d0a-95e5-9dae41709727 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:21.044822 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a0bbfad7-7a54-4d0a-95e5-9dae41709727 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:21.045259 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a0bbfad7-7a54-4d0a-95e5-9dae41709727 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:21.069549 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-a0bbfad7-7a54-4d0a-95e5-9dae41709727 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Going to try to terminate instance {{(pid=129584) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:51:21.116606 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:21.120210 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8d9d927c-5af0-4581-bee1-4b51c42e57e5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:21.120847 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8d9d927c-5af0-4581-bee1-4b51c42e57e5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:21.127578 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8d9d927c-5af0-4581-bee1-4b51c42e57e5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:21.128040 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8d9d927c-5af0-4581-bee1-4b51c42e57e5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:21.128820 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8d9d927c-5af0-4581-bee1-4b51c42e57e5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:21.129252 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8d9d927c-5af0-4581-bee1-4b51c42e57e5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:21.133375 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:21.156160 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-a0bbfad7-7a54-4d0a-95e5-9dae41709727 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "DELETE /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 204 len: 0 microversion: 2.1 time: 0.123192 Jul 29 11:51:21.156817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 292/570] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:51:21 2022] DELETE /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:51:21.165833 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-09c3bc39-b5a2-410e-9654-548275c142ed tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:21.166528 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-09c3bc39-b5a2-410e-9654-548275c142ed tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:21.172704 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-09c3bc39-b5a2-410e-9654-548275c142ed tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:21.173156 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-09c3bc39-b5a2-410e-9654-548275c142ed tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:21.173953 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-09c3bc39-b5a2-410e-9654-548275c142ed tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:21.174568 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-09c3bc39-b5a2-410e-9654-548275c142ed tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:21.270365 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-8d9d927c-5af0-4581-bee1-4b51c42e57e5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:21.278347 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8d9d927c-5af0-4581-bee1-4b51c42e57e5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1358 microversion: 2.1 time: 0.162137 Jul 29 11:51:21.278997 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 279/571] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:21 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:51:21.369287 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-09c3bc39-b5a2-410e-9654-548275c142ed tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:21.377473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-09c3bc39-b5a2-410e-9654-548275c142ed tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1507 microversion: 2.1 time: 0.215904 Jul 29 11:51:21.378039 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 293/572] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:21 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:51:22.299323 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-f984c9da-d379-4939-85d5-8011081de1c9 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:22.299964 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-f984c9da-d379-4939-85d5-8011081de1c9 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:22.307255 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f984c9da-d379-4939-85d5-8011081de1c9 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:22.308267 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f984c9da-d379-4939-85d5-8011081de1c9 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:22.309037 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f984c9da-d379-4939-85d5-8011081de1c9 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:22.309513 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f984c9da-d379-4939-85d5-8011081de1c9 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:22.399485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b44b4b90-1c08-4a27-a530-5c63d50aad0a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:22.400111 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b44b4b90-1c08-4a27-a530-5c63d50aad0a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:22.406849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b44b4b90-1c08-4a27-a530-5c63d50aad0a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:22.407380 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b44b4b90-1c08-4a27-a530-5c63d50aad0a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:22.408222 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b44b4b90-1c08-4a27-a530-5c63d50aad0a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:22.408736 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b44b4b90-1c08-4a27-a530-5c63d50aad0a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:22.438090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-f984c9da-d379-4939-85d5-8011081de1c9 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:22.445658 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-f984c9da-d379-4939-85d5-8011081de1c9 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1358 microversion: 2.1 time: 0.150375 Jul 29 11:51:22.446338 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 280/573] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:22 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:22.538063 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b44b4b90-1c08-4a27-a530-5c63d50aad0a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:22.545513 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b44b4b90-1c08-4a27-a530-5c63d50aad0a tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1507 microversion: 2.1 time: 0.149998 Jul 29 11:51:22.546107 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 294/574] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:22 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:51:23.467862 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-f0a00702-f5fb-4dbc-adda-bed04060b0e3 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:23.468431 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-f0a00702-f5fb-4dbc-adda-bed04060b0e3 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:23.475055 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f0a00702-f5fb-4dbc-adda-bed04060b0e3 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:23.475511 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f0a00702-f5fb-4dbc-adda-bed04060b0e3 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:23.476296 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f0a00702-f5fb-4dbc-adda-bed04060b0e3 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:23.476736 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f0a00702-f5fb-4dbc-adda-bed04060b0e3 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:23.566921 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-df24b801-7c5d-431a-8720-b526f41fca89 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:23.567542 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-df24b801-7c5d-431a-8720-b526f41fca89 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:23.574858 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-df24b801-7c5d-431a-8720-b526f41fca89 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:23.575885 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-df24b801-7c5d-431a-8720-b526f41fca89 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:23.576085 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-df24b801-7c5d-431a-8720-b526f41fca89 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:23.576525 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-df24b801-7c5d-431a-8720-b526f41fca89 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:23.609972 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-f0a00702-f5fb-4dbc-adda-bed04060b0e3 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:23.617629 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-f0a00702-f5fb-4dbc-adda-bed04060b0e3 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1358 microversion: 2.1 time: 0.154672 Jul 29 11:51:23.618203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 281/575] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:23 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:23.707392 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-df24b801-7c5d-431a-8720-b526f41fca89 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:23.715721 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-df24b801-7c5d-431a-8720-b526f41fca89 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1507 microversion: 2.1 time: 0.152599 Jul 29 11:51:23.716519 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 295/576] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:23 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:51:23.875798 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-a41f85e6-5efd-4843-b6a5-6c028823d878 req-7cd8c8c3-fc29-4c3d-991b-b28bdd204795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f49b2279-4842-4a6c-8dc4-c3429b36f44b", "name": "network-vif-plugged", "status": "completed", "tag": "60afe5bb-47c8-40c1-8b64-67d4e2f7c626"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:23.886896 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-a41f85e6-5efd-4843-b6a5-6c028823d878 req-7cd8c8c3-fc29-4c3d-991b-b28bdd204795 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:23.887345 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-a41f85e6-5efd-4843-b6a5-6c028823d878 req-7cd8c8c3-fc29-4c3d-991b-b28bdd204795 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:23.898972 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-a41f85e6-5efd-4843-b6a5-6c028823d878 req-7cd8c8c3-fc29-4c3d-991b-b28bdd204795 service nova] Creating event network-vif-plugged:60afe5bb-47c8-40c1-8b64-67d4e2f7c626 for instance f49b2279-4842-4a6c-8dc4-c3429b36f44b on hv-cinder-83754 Jul 29 11:51:23.905020 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-a41f85e6-5efd-4843-b6a5-6c028823d878 req-7cd8c8c3-fc29-4c3d-991b-b28bdd204795 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033446 Jul 29 11:51:23.905645 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 282/577] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:24.192446 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-f295bbbe-af2b-474f-8e9d-fa0aed3c279b req-9dfdc034-8229-46a9-a296-bed9efe55f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600bd88b-d9ed-4efe-a4fe-5ae8a93497c9", "name": "network-vif-deleted", "tag": "c7dcc6c9-56c0-4221-a382-4dc2c7a538eb"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:24.205299 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-f295bbbe-af2b-474f-8e9d-fa0aed3c279b req-9dfdc034-8229-46a9-a296-bed9efe55f63 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:24.206302 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-f295bbbe-af2b-474f-8e9d-fa0aed3c279b req-9dfdc034-8229-46a9-a296-bed9efe55f63 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:24.220887 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-f295bbbe-af2b-474f-8e9d-fa0aed3c279b req-9dfdc034-8229-46a9-a296-bed9efe55f63 service nova] Creating event network-vif-deleted:c7dcc6c9-56c0-4221-a382-4dc2c7a538eb for instance 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 on hv-cinder-83754 Jul 29 11:51:24.225546 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-f295bbbe-af2b-474f-8e9d-fa0aed3c279b req-9dfdc034-8229-46a9-a296-bed9efe55f63 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051773 Jul 29 11:51:24.226130 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 296/578] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:24.641004 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-51affc64-0dc4-45fb-9fb3-21aa4d6eb8f2 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:24.641730 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-51affc64-0dc4-45fb-9fb3-21aa4d6eb8f2 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:24.648141 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-51affc64-0dc4-45fb-9fb3-21aa4d6eb8f2 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:24.648599 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-51affc64-0dc4-45fb-9fb3-21aa4d6eb8f2 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:24.649373 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-51affc64-0dc4-45fb-9fb3-21aa4d6eb8f2 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:24.649848 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-51affc64-0dc4-45fb-9fb3-21aa4d6eb8f2 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:24.737486 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f4ac3528-cc0e-4d3f-9d6a-e01de07ed35e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:24.738203 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f4ac3528-cc0e-4d3f-9d6a-e01de07ed35e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:24.744638 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f4ac3528-cc0e-4d3f-9d6a-e01de07ed35e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:24.745189 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f4ac3528-cc0e-4d3f-9d6a-e01de07ed35e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:24.746003 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f4ac3528-cc0e-4d3f-9d6a-e01de07ed35e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:24.746447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f4ac3528-cc0e-4d3f-9d6a-e01de07ed35e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:24.779510 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f4ac3528-cc0e-4d3f-9d6a-e01de07ed35e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:24.779962 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f4ac3528-cc0e-4d3f-9d6a-e01de07ed35e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:24.780412 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-f4ac3528-cc0e-4d3f-9d6a-e01de07ed35e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lazy-loading 'fault' on Instance uuid 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:51:24.792786 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-51affc64-0dc4-45fb-9fb3-21aa4d6eb8f2 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:24.800702 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-51affc64-0dc4-45fb-9fb3-21aa4d6eb8f2 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1358 microversion: 2.1 time: 0.165402 Jul 29 11:51:24.801289 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 283/579] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:24 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:24.823869 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f4ac3528-cc0e-4d3f-9d6a-e01de07ed35e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:24.836766 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f4ac3528-cc0e-4d3f-9d6a-e01de07ed35e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 200 len: 1312 microversion: 2.1 time: 0.104041 Jul 29 11:51:24.837457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 297/580] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:24 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:51:25.824309 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4de2b053-3626-4575-8fcc-d8758603fc39 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:25.824927 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4de2b053-3626-4575-8fcc-d8758603fc39 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:25.831475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4de2b053-3626-4575-8fcc-d8758603fc39 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:25.831939 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4de2b053-3626-4575-8fcc-d8758603fc39 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:25.832713 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4de2b053-3626-4575-8fcc-d8758603fc39 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:25.833160 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4de2b053-3626-4575-8fcc-d8758603fc39 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:25.859104 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-32e6733e-96fa-4406-994a-651e208ccf66 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:25.859805 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-32e6733e-96fa-4406-994a-651e208ccf66 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:25.866326 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-32e6733e-96fa-4406-994a-651e208ccf66 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:25.866778 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-32e6733e-96fa-4406-994a-651e208ccf66 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:25.867543 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-32e6733e-96fa-4406-994a-651e208ccf66 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:25.868008 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-32e6733e-96fa-4406-994a-651e208ccf66 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:25.882035 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-32e6733e-96fa-4406-994a-651e208ccf66 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] HTTP exception thrown: Instance 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 could not be found. Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-32e6733e-96fa-4406-994a-651e208ccf66 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Request method failure captured: Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 HTTP/1.1 Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48icWNF5VduBTIvjMx74oGekPjDM_WyPKfDFEqTnYbP9pmMYJ3iVEIhDcbFTI1aIEBtbuMVZ512qIJ9lmpywo_t0j8JU4KEV9fFpkjZDe9V6y8DrRt8ODhPkRG0qurIOC8MLkMcQJ5L6wWkf-02BMuHwG4Gsjsp_xiI86N4-AN7FChY Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 106664c99e9c4a0d9a9c9c05e08a3d7f Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1574150610 Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:51:25.883674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:51:25.885125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/106664c99e9c4a0d9a9c9c05e08a3d7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_106664c99e9c4a0d9a9c9c05e08a3d7f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/106664c99e9c4a0d9a9c9c05e08a3d7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/106664c99e9c4a0d9a9c9c05e08a3d7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:51:25.885125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1574150610 Jul 29 11:51:25.885125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 106664c99e9c4a0d9a9c9c05e08a3d7f Jul 29 11:51:25.885125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1574150610 Jul 29 11:51:25.885125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-ServerRescueNegativeTestJSON-1574150610-project Jul 29 11:51:25.885125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:51:25.885125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:51:25.885125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 9d341bba8dda445ca4eac6d52aa9f80c Jul 29 11:51:25.885125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1574150610-project Jul 29 11:51:25.885125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:51:25.885125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 could not be found. Jul 29 11:51:25.885125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '600bd88b-d9ed-4efe-a4fe-5ae8a93497c9'} Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 could not be found. Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:51:25.886447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 could not be found. Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 could not be found. Jul 29 11:51:25.887820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:51:25.889481 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-32e6733e-96fa-4406-994a-651e208ccf66 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Returning 404 to user: Instance 600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:51:25.889481 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-32e6733e-96fa-4406-994a-651e208ccf66 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9" status: 404 len: 111 microversion: 2.1 time: 0.029816 Jul 29 11:51:25.889481 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 298/581] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:25 2022] GET /compute/v2.1/servers/600bd88b-d9ed-4efe-a4fe-5ae8a93497c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:51:25.893661 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3031b1a7-f65b-4a8c-950c-108dd0c42d7e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:25.894163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3031b1a7-f65b-4a8c-950c-108dd0c42d7e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:25.902253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3031b1a7-f65b-4a8c-950c-108dd0c42d7e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:25.903032 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3031b1a7-f65b-4a8c-950c-108dd0c42d7e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:25.903887 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3031b1a7-f65b-4a8c-950c-108dd0c42d7e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:25.904471 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3031b1a7-f65b-4a8c-950c-108dd0c42d7e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:25.930959 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3031b1a7-f65b-4a8c-950c-108dd0c42d7e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Going to try to terminate instance {{(pid=129584) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:51:25.966007 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-4de2b053-3626-4575-8fcc-d8758603fc39 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:25.974254 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4de2b053-3626-4575-8fcc-d8758603fc39 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1548 microversion: 2.1 time: 0.154027 Jul 29 11:51:25.974822 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 284/582] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:25 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:25.996237 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-d20504dd-734e-4b67-8be4-d8dee9bbe596 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:25.996938 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-d20504dd-734e-4b67-8be4-d8dee9bbe596 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:26.003037 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d20504dd-734e-4b67-8be4-d8dee9bbe596 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:26.003512 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d20504dd-734e-4b67-8be4-d8dee9bbe596 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:26.004384 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d20504dd-734e-4b67-8be4-d8dee9bbe596 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:26.004790 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d20504dd-734e-4b67-8be4-d8dee9bbe596 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:26.008740 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3031b1a7-f65b-4a8c-950c-108dd0c42d7e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 204 len: 0 microversion: 2.1 time: 0.118315 Jul 29 11:51:26.009329 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 299/583] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:51:25 2022] DELETE /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 11:51:26.018042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-005cfc65-7ffc-4d80-9168-a8ab2c20e793 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:26.018748 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-005cfc65-7ffc-4d80-9168-a8ab2c20e793 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:26.024652 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-005cfc65-7ffc-4d80-9168-a8ab2c20e793 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:26.025145 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-005cfc65-7ffc-4d80-9168-a8ab2c20e793 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:26.026506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-005cfc65-7ffc-4d80-9168-a8ab2c20e793 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:26.026961 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-005cfc65-7ffc-4d80-9168-a8ab2c20e793 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:26.201146 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-d20504dd-734e-4b67-8be4-d8dee9bbe596 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:26.211763 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-d20504dd-734e-4b67-8be4-d8dee9bbe596 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1548 microversion: 2.1 time: 0.219515 Jul 29 11:51:26.212462 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 285/584] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:25 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1548 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:51:26.213366 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-005cfc65-7ffc-4d80-9168-a8ab2c20e793 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:26.225135 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-005cfc65-7ffc-4d80-9168-a8ab2c20e793 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.211193 Jul 29 11:51:26.226678 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 300/585] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:26 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:51:26.232831 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-fa8f3fb5-e319-49cb-afa2-ea454d6e1fe7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:26.238638 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fa8f3fb5-e319-49cb-afa2-ea454d6e1fe7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:26.239608 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-fa8f3fb5-e319-49cb-afa2-ea454d6e1fe7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Searching by: {'deleted': False, 'project_id': '861c5a0403c94abd9ae479175604c835'} {{(pid=129585) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 29 11:51:26.248135 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fa8f3fb5-e319-49cb-afa2-ea454d6e1fe7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:26.248587 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fa8f3fb5-e319-49cb-afa2-ea454d6e1fe7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:26.249431 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fa8f3fb5-e319-49cb-afa2-ea454d6e1fe7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:26.249872 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fa8f3fb5-e319-49cb-afa2-ea454d6e1fe7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:26.338954 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.multi_cell_list [None req-fa8f3fb5-e319-49cb-afa2-ea454d6e1fe7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 29 11:51:26.434725 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-fa8f3fb5-e319-49cb-afa2-ea454d6e1fe7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206317 Jul 29 11:51:26.435345 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 286/586] 10.222.0.60 () {58 vars in 1125 bytes} [Fri Jul 29 11:51:26 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:26.447290 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-dc23bdc0-48b2-49f1-b148-8ded40f5caa1 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:26.448401 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-dc23bdc0-48b2-49f1-b148-8ded40f5caa1 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:26.454393 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dc23bdc0-48b2-49f1-b148-8ded40f5caa1 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:26.454846 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dc23bdc0-48b2-49f1-b148-8ded40f5caa1 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:26.455616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dc23bdc0-48b2-49f1-b148-8ded40f5caa1 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:26.456055 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dc23bdc0-48b2-49f1-b148-8ded40f5caa1 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:26.588998 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-dc23bdc0-48b2-49f1-b148-8ded40f5caa1 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:26.596581 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-dc23bdc0-48b2-49f1-b148-8ded40f5caa1 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1548 microversion: 2.1 time: 0.153100 Jul 29 11:51:26.597144 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 301/587] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:26 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:27.248365 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e46f5949-ffe5-487c-bc9c-018ed8054801 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:27.248987 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e46f5949-ffe5-487c-bc9c-018ed8054801 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:27.255591 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e46f5949-ffe5-487c-bc9c-018ed8054801 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:27.256050 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e46f5949-ffe5-487c-bc9c-018ed8054801 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:27.256817 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e46f5949-ffe5-487c-bc9c-018ed8054801 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:27.257270 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e46f5949-ffe5-487c-bc9c-018ed8054801 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:27.383781 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e46f5949-ffe5-487c-bc9c-018ed8054801 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:27.392219 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e46f5949-ffe5-487c-bc9c-018ed8054801 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.148308 Jul 29 11:51:27.392817 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 287/588] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:27 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:27.501279 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9d8dcae9-4bf4-4dce-8c06-019c8df3a752 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:27.501844 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-9d8dcae9-4bf4-4dce-8c06-019c8df3a752 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:27.508292 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9d8dcae9-4bf4-4dce-8c06-019c8df3a752 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:27.508738 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9d8dcae9-4bf4-4dce-8c06-019c8df3a752 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:27.509518 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9d8dcae9-4bf4-4dce-8c06-019c8df3a752 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:27.509948 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9d8dcae9-4bf4-4dce-8c06-019c8df3a752 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:27.533045 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-9d8dcae9-4bf4-4dce-8c06-019c8df3a752 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/ips" status: 200 len: 150 microversion: 2.1 time: 0.036091 Jul 29 11:51:27.533637 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 302/589] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Jul 29 11:51:27 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:28.128103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4cc8b9bc-8a25-4671-ac83-581411ebba85 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6eb560e-828b-475d-bbc9-53b1bf16573a"}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:28.130511 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4cc8b9bc-8a25-4671-ac83-581411ebba85 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:28.136934 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4cc8b9bc-8a25-4671-ac83-581411ebba85 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:28.137394 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4cc8b9bc-8a25-4671-ac83-581411ebba85 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:28.138190 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4cc8b9bc-8a25-4671-ac83-581411ebba85 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:28.138629 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4cc8b9bc-8a25-4671-ac83-581411ebba85 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:28.413446 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-442b9ed9-b654-4ca1-805d-094094867788 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:28.414030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-442b9ed9-b654-4ca1-805d-094094867788 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:28.417602 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:28.421636 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-442b9ed9-b654-4ca1-805d-094094867788 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:28.422092 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-442b9ed9-b654-4ca1-805d-094094867788 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:28.422871 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-442b9ed9-b654-4ca1-805d-094094867788 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:28.423331 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-442b9ed9-b654-4ca1-805d-094094867788 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:28.555416 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-442b9ed9-b654-4ca1-805d-094094867788 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:28.563558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-442b9ed9-b654-4ca1-805d-094094867788 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.154141 Jul 29 11:51:28.564118 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 303/590] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:28 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:51:28.865481 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1b9d9809-7e0f-40c4-90d7-67a7cfec92cd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fb30462-50ef-46e3-8fe7-5ea53088aa53"}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:28.867926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-1b9d9809-7e0f-40c4-90d7-67a7cfec92cd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:28.874564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1b9d9809-7e0f-40c4-90d7-67a7cfec92cd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:28.875012 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1b9d9809-7e0f-40c4-90d7-67a7cfec92cd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:28.875777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1b9d9809-7e0f-40c4-90d7-67a7cfec92cd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:28.876215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1b9d9809-7e0f-40c4-90d7-67a7cfec92cd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:29.413876 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1b9d9809-7e0f-40c4-90d7-67a7cfec92cd tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "POST /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.552215 Jul 29 11:51:29.414491 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 304/591] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Jul 29 11:51:28 2022] POST /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments => generated 194 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:51:29.454521 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4cc8b9bc-8a25-4671-ac83-581411ebba85 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "POST /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.330029 Jul 29 11:51:29.454969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 288/592] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Jul 29 11:51:28 2022] POST /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/os-volume_attachments => generated 194 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:29.585723 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3c45d2d4-0a08-47c7-9396-95ee86e8e24e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:29.586427 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3c45d2d4-0a08-47c7-9396-95ee86e8e24e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:29.593208 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3c45d2d4-0a08-47c7-9396-95ee86e8e24e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:29.593704 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3c45d2d4-0a08-47c7-9396-95ee86e8e24e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:29.594473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3c45d2d4-0a08-47c7-9396-95ee86e8e24e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:29.594912 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3c45d2d4-0a08-47c7-9396-95ee86e8e24e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:29.734968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3c45d2d4-0a08-47c7-9396-95ee86e8e24e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d341bba8dda445ca4eac6d52aa9f80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106664c99e9c4a0d9a9c9c05e08a3d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:29.750182 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3c45d2d4-0a08-47c7-9396-95ee86e8e24e tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 200 len: 1522 microversion: 2.1 time: 0.168787 Jul 29 11:51:29.767495 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 305/593] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:29 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:30.185479 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-37dbdb8c-ad8f-4d98-b346-a2b2be57eb93 req-86da6b4a-d68b-4ea2-8cce-03be94d70f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e39f512-b616-4e06-9f81-f853454d67aa", "name": "network-vif-deleted", "tag": "a089bb79-5e40-4138-a8cf-26b1b99b5535"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:30.197210 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-37dbdb8c-ad8f-4d98-b346-a2b2be57eb93 req-86da6b4a-d68b-4ea2-8cce-03be94d70f60 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:30.197659 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-37dbdb8c-ad8f-4d98-b346-a2b2be57eb93 req-86da6b4a-d68b-4ea2-8cce-03be94d70f60 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:30.209228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-37dbdb8c-ad8f-4d98-b346-a2b2be57eb93 req-86da6b4a-d68b-4ea2-8cce-03be94d70f60 service nova] Creating event network-vif-deleted:a089bb79-5e40-4138-a8cf-26b1b99b5535 for instance 8e39f512-b616-4e06-9f81-f853454d67aa on hv-cinder-83754 Jul 29 11:51:30.214598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-37dbdb8c-ad8f-4d98-b346-a2b2be57eb93 req-86da6b4a-d68b-4ea2-8cce-03be94d70f60 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034369 Jul 29 11:51:30.215159 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 289/594] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:30.253481 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6fec592d-ae8e-4d72-aa3f-6270049cd235 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:30.254194 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6fec592d-ae8e-4d72-aa3f-6270049cd235 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:30.261166 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6fec592d-ae8e-4d72-aa3f-6270049cd235 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:30.261672 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6fec592d-ae8e-4d72-aa3f-6270049cd235 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:30.262443 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6fec592d-ae8e-4d72-aa3f-6270049cd235 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:30.263454 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6fec592d-ae8e-4d72-aa3f-6270049cd235 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:30.289705 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-6fec592d-ae8e-4d72-aa3f-6270049cd235 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b/ips" status: 200 len: 153 microversion: 2.20 time: 0.040184 Jul 29 11:51:30.290446 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 306/595] 10.222.0.60 () {60 vars in 1289 bytes} [Fri Jul 29 11:51:30 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b/ips => generated 153 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 11:51:30.775350 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8d21510d-92f1-483c-baad-1801d1aab8e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:30.776668 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8d21510d-92f1-483c-baad-1801d1aab8e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] [instance: 8e39f512-b616-4e06-9f81-f853454d67aa] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:30.782887 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8d21510d-92f1-483c-baad-1801d1aab8e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:30.783342 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8d21510d-92f1-483c-baad-1801d1aab8e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:30.784114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8d21510d-92f1-483c-baad-1801d1aab8e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:30.784552 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8d21510d-92f1-483c-baad-1801d1aab8e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:30.797970 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-8d21510d-92f1-483c-baad-1801d1aab8e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] HTTP exception thrown: Instance 8e39f512-b616-4e06-9f81-f853454d67aa could not be found. Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8d21510d-92f1-483c-baad-1801d1aab8e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Request method failure captured: Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa HTTP/1.1 Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48icWNF5VduBTIvjMx74oGekPjDM_WyPKfDFEqTnYbP9pmMYJ3iVEIhDcbFTI1aIEBtbuMVZ512qIJ9lmpywo_t0j8JU4KEV9fFpkjZDe9V6y8DrRt8ODhPkRG0qurIOC8MLkMcQJ5L6wWkf-02BMuHwG4Gsjsp_xiI86N4-AN7FChY Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 106664c99e9c4a0d9a9c9c05e08a3d7f Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1574150610 Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:51:30.799598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:51:30.801090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/106664c99e9c4a0d9a9c9c05e08a3d7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_106664c99e9c4a0d9a9c9c05e08a3d7f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/106664c99e9c4a0d9a9c9c05e08a3d7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/106664c99e9c4a0d9a9c9c05e08a3d7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:51:30.801090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1574150610 Jul 29 11:51:30.801090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 106664c99e9c4a0d9a9c9c05e08a3d7f Jul 29 11:51:30.801090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1574150610 Jul 29 11:51:30.801090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-ServerRescueNegativeTestJSON-1574150610-project Jul 29 11:51:30.801090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:51:30.801090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:51:30.801090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 9d341bba8dda445ca4eac6d52aa9f80c Jul 29 11:51:30.801090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1574150610-project Jul 29 11:51:30.801090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:51:30.801090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance 8e39f512-b616-4e06-9f81-f853454d67aa could not be found. Jul 29 11:51:30.801090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': '8e39f512-b616-4e06-9f81-f853454d67aa'} Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e39f512-b616-4e06-9f81-f853454d67aa could not be found. Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:51:30.802203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e39f512-b616-4e06-9f81-f853454d67aa could not be found. Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e39f512-b616-4e06-9f81-f853454d67aa could not be found. Jul 29 11:51:30.803758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:51:30.805105 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8d21510d-92f1-483c-baad-1801d1aab8e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] Returning 404 to user: Instance 8e39f512-b616-4e06-9f81-f853454d67aa could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:51:30.805105 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8d21510d-92f1-483c-baad-1801d1aab8e0 tempest-ServerRescueNegativeTestJSON-1574150610 tempest-ServerRescueNegativeTestJSON-1574150610-project] 10.222.0.60 "GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa" status: 404 len: 111 microversion: 2.1 time: 0.030371 Jul 29 11:51:30.806822 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 290/596] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:30 2022] GET /compute/v2.1/servers/8e39f512-b616-4e06-9f81-f853454d67aa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:51:32.784340 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c786a0d9-983f-4ddf-82dd-9551fc300f08 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:32.784879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c786a0d9-983f-4ddf-82dd-9551fc300f08 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:32.792230 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c786a0d9-983f-4ddf-82dd-9551fc300f08 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:32.792900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c786a0d9-983f-4ddf-82dd-9551fc300f08 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:32.793711 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c786a0d9-983f-4ddf-82dd-9551fc300f08 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:32.794149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c786a0d9-983f-4ddf-82dd-9551fc300f08 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:32.817522 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-c786a0d9-983f-4ddf-82dd-9551fc300f08 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lazy-loading 'flavor' on Instance uuid 21b28697-8f3b-4087-ae1b-836eb376d11b {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:51:32.821354 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:33.018533 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c786a0d9-983f-4ddf-82dd-9551fc300f08 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "POST /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b/action" status: 202 len: 0 microversion: 2.20 time: 0.237835 Jul 29 11:51:33.019347 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 307/597] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Jul 29 11:51:32 2022] POST /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:51:33.028795 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-1818d5bb-ee0d-4612-96dc-5f2d9e6b00ff tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:33.029403 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-1818d5bb-ee0d-4612-96dc-5f2d9e6b00ff tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:33.031995 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:33.037602 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1818d5bb-ee0d-4612-96dc-5f2d9e6b00ff tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:33.038277 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1818d5bb-ee0d-4612-96dc-5f2d9e6b00ff tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:33.040437 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1818d5bb-ee0d-4612-96dc-5f2d9e6b00ff tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:33.041692 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1818d5bb-ee0d-4612-96dc-5f2d9e6b00ff tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:33.204415 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-1818d5bb-ee0d-4612-96dc-5f2d9e6b00ff tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:33.213983 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-1818d5bb-ee0d-4612-96dc-5f2d9e6b00ff tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:33.215775 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-1818d5bb-ee0d-4612-96dc-5f2d9e6b00ff tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:33.217233 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-1818d5bb-ee0d-4612-96dc-5f2d9e6b00ff tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.192934 Jul 29 11:51:33.217889 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 291/598] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:33 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:51:34.246415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6ccfb4fc-cd9f-4ba5-ba6e-2e6a35c57e87 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:34.247369 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6ccfb4fc-cd9f-4ba5-ba6e-2e6a35c57e87 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:34.254479 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6ccfb4fc-cd9f-4ba5-ba6e-2e6a35c57e87 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:34.254956 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6ccfb4fc-cd9f-4ba5-ba6e-2e6a35c57e87 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:34.255743 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6ccfb4fc-cd9f-4ba5-ba6e-2e6a35c57e87 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:34.256175 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6ccfb4fc-cd9f-4ba5-ba6e-2e6a35c57e87 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:34.431548 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6ccfb4fc-cd9f-4ba5-ba6e-2e6a35c57e87 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:34.440559 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6ccfb4fc-cd9f-4ba5-ba6e-2e6a35c57e87 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:34.442298 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6ccfb4fc-cd9f-4ba5-ba6e-2e6a35c57e87 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:34.445267 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-6ccfb4fc-cd9f-4ba5-ba6e-2e6a35c57e87 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.207715 Jul 29 11:51:34.455994 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 308/599] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:34 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:51:35.468636 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8e45f1fe-031c-43ab-b510-2cef4d1effbe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:35.469255 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8e45f1fe-031c-43ab-b510-2cef4d1effbe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:35.475865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8e45f1fe-031c-43ab-b510-2cef4d1effbe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:35.476328 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8e45f1fe-031c-43ab-b510-2cef4d1effbe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:35.477100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8e45f1fe-031c-43ab-b510-2cef4d1effbe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:35.477574 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8e45f1fe-031c-43ab-b510-2cef4d1effbe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:35.633673 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-8e45f1fe-031c-43ab-b510-2cef4d1effbe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:35.642438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-8e45f1fe-031c-43ab-b510-2cef4d1effbe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:35.643923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-8e45f1fe-031c-43ab-b510-2cef4d1effbe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:35.645091 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8e45f1fe-031c-43ab-b510-2cef4d1effbe tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.180845 Jul 29 11:51:35.645855 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 292/600] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:35 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:51:36.669314 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-49eacff5-7123-4715-97f7-a84be0ce5b37 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:36.669881 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-49eacff5-7123-4715-97f7-a84be0ce5b37 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:36.676403 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-49eacff5-7123-4715-97f7-a84be0ce5b37 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:36.676857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-49eacff5-7123-4715-97f7-a84be0ce5b37 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:36.677651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-49eacff5-7123-4715-97f7-a84be0ce5b37 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:36.678090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-49eacff5-7123-4715-97f7-a84be0ce5b37 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:36.804921 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-49eacff5-7123-4715-97f7-a84be0ce5b37 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:36.813378 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-49eacff5-7123-4715-97f7-a84be0ce5b37 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:36.814898 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-49eacff5-7123-4715-97f7-a84be0ce5b37 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:36.816059 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-49eacff5-7123-4715-97f7-a84be0ce5b37 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.151349 Jul 29 11:51:36.816614 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 309/601] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:36 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:51:36.893347 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-7d6169d7-38e2-436e-a0fb-64889568feb0 tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] Calling method '.version_select at 0x7f68f9f01790>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:36.899732 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:36.943167 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-7d6169d7-38e2-436e-a0fb-64889568feb0 tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c637a2a3-3154-45f9-a890-cc18c0f8b860" status: 200 len: 350 microversion: 2.1 time: 0.053474 Jul 29 11:51:36.943970 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 293/602] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:51:36 2022] GET /compute/v2.1/os-volumes/c637a2a3-3154-45f9-a890-cc18c0f8b860 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:37.019370 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4c4e4561-cd5c-4f1a-ba26-3ffa28dde0d1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fb30462-50ef-46e3-8fe7-5ea53088aa53"}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:37.021792 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-4c4e4561-cd5c-4f1a-ba26-3ffa28dde0d1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:37.028169 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4c4e4561-cd5c-4f1a-ba26-3ffa28dde0d1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:37.028614 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4c4e4561-cd5c-4f1a-ba26-3ffa28dde0d1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:37.029376 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4c4e4561-cd5c-4f1a-ba26-3ffa28dde0d1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:37.029852 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4c4e4561-cd5c-4f1a-ba26-3ffa28dde0d1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:37.108598 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-4c4e4561-cd5c-4f1a-ba26-3ffa28dde0d1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] HTTP exception thrown: Invalid volume: volume 5fb30462-50ef-46e3-8fe7-5ea53088aa53 is already attached to instances: 439cbe53-546a-4902-a4e7-c25b4a7b84d0 Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4c4e4561-cd5c-4f1a-ba26-3ffa28dde0d1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Request method failure captured: Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: POST /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments HTTP/1.1 Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 74 Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48icVbGQpo_IdH8_u62UoQcPfoUo3xwllOW7fjakcJXUphVjQAJzVqE7fI-fsqP3g4NqZjz8YFLyejjO-VLv92lJBWa3RdJ2AtZ841GWsHIbm-PB-ZcSKgDGNNp_FYxiDV5ReNSeL7mFuVa5RErCcpxqZKkcIeuKO_mbw7bKo_jOIw8 Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:51:37.110342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:51:37.111904 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4b9969357142bc8724804eb47e0c48", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:51:37.111904 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:51:37.111904 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:51:37.111904 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:51:37.111904 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:51:37.111904 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:51:37.111904 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:51:37.111904 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 1a343996462b462d86fb89b876f4e127 Jul 29 11:51:37.111904 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:51:37.111904 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Jul 29 11:51:37.111904 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {"volumeAttachment": {"volumeId": "5fb30462-50ef-46e3-8fe7-5ea53088aa53"}} Jul 29 11:51:37.111904 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Invalid volume: volume 5fb30462-50ef-46e3-8fe7-5ea53088aa53 is already attached to instances: 439cbe53-546a-4902-a4e7-c25b4a7b84d0 Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'server_id': '439cbe53-546a-4902-a4e7-c25b4a7b84d0', 'body': {'volumeAttachment': {'volumeId': '5fb30462-50ef-46e3-8fe7-5ea53088aa53'}}} Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5fb30462-50ef-46e3-8fe7-5ea53088aa53 is already attached to instances: 439cbe53-546a-4902-a4e7-c25b4a7b84d0 Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:51:37.113241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5fb30462-50ef-46e3-8fe7-5ea53088aa53 is already attached to instances: 439cbe53-546a-4902-a4e7-c25b4a7b84d0 Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:51:37.114742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:51:37.116776 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:51:37.116776 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:51:37.116776 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:51:37.116776 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5fb30462-50ef-46e3-8fe7-5ea53088aa53 is already attached to instances: 439cbe53-546a-4902-a4e7-c25b4a7b84d0 Jul 29 11:51:37.116776 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:51:37.116776 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4c4e4561-cd5c-4f1a-ba26-3ffa28dde0d1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Returning 400 to user: Invalid volume: volume 5fb30462-50ef-46e3-8fe7-5ea53088aa53 is already attached to instances: 439cbe53-546a-4902-a4e7-c25b4a7b84d0 {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:51:37.116776 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-4c4e4561-cd5c-4f1a-ba26-3ffa28dde0d1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "POST /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096354 Jul 29 11:51:37.116776 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 310/603] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Jul 29 11:51:37 2022] POST /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 11:51:37.177001 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-161c98c4-05e6-4f9a-8bca-2ae9d565a28b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:37.177533 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-161c98c4-05e6-4f9a-8bca-2ae9d565a28b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:37.184557 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-161c98c4-05e6-4f9a-8bca-2ae9d565a28b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:37.185013 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-161c98c4-05e6-4f9a-8bca-2ae9d565a28b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:37.185814 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-161c98c4-05e6-4f9a-8bca-2ae9d565a28b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:37.186259 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-161c98c4-05e6-4f9a-8bca-2ae9d565a28b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:37.279971 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.objects.instance [None req-161c98c4-05e6-4f9a-8bca-2ae9d565a28b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lazy-loading 'services' on Instance uuid 439cbe53-546a-4902-a4e7-c25b4a7b84d0 {{(pid=129585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:51:37.354156 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-161c98c4-05e6-4f9a-8bca-2ae9d565a28b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "DELETE /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments/5fb30462-50ef-46e3-8fe7-5ea53088aa53" status: 202 len: 0 microversion: 2.1 time: 0.180265 Jul 29 11:51:37.355101 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 294/604] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Jul 29 11:51:37 2022] DELETE /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments/5fb30462-50ef-46e3-8fe7-5ea53088aa53 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:51:37.363220 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-adbeb14b-afe6-441c-b175-f6f2a0fa59a1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:37.365554 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-adbeb14b-afe6-441c-b175-f6f2a0fa59a1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:37.372366 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-adbeb14b-afe6-441c-b175-f6f2a0fa59a1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:37.372813 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-adbeb14b-afe6-441c-b175-f6f2a0fa59a1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:37.374049 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-adbeb14b-afe6-441c-b175-f6f2a0fa59a1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:37.374173 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-adbeb14b-afe6-441c-b175-f6f2a0fa59a1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:37.405261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-adbeb14b-afe6-441c-b175-f6f2a0fa59a1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045845 Jul 29 11:51:37.406125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 311/605] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:51:37 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:51:37.839878 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-fcc45378-8bce-4e9a-9c3e-5ddfd8b07719 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:37.840487 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-fcc45378-8bce-4e9a-9c3e-5ddfd8b07719 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:37.847060 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fcc45378-8bce-4e9a-9c3e-5ddfd8b07719 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:37.847518 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fcc45378-8bce-4e9a-9c3e-5ddfd8b07719 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:37.848339 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fcc45378-8bce-4e9a-9c3e-5ddfd8b07719 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:37.848814 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fcc45378-8bce-4e9a-9c3e-5ddfd8b07719 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:37.980253 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fcc45378-8bce-4e9a-9c3e-5ddfd8b07719 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:37.988318 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fcc45378-8bce-4e9a-9c3e-5ddfd8b07719 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:37.989868 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fcc45378-8bce-4e9a-9c3e-5ddfd8b07719 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:37.991034 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-fcc45378-8bce-4e9a-9c3e-5ddfd8b07719 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.156067 Jul 29 11:51:37.991595 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 295/606] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:37 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:51:38.336319 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ce6b3637-91dd-436c-9bf2-f4a9f431e01b tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] Calling method '.version_select at 0x7f68f9fc6c10>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:38.383515 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ce6b3637-91dd-436c-9bf2-f4a9f431e01b tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a81c6cf7-de15-4059-bf60-4b890aab1bf3" status: 200 len: 350 microversion: 2.1 time: 0.052114 Jul 29 11:51:38.384091 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 312/607] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:51:38 2022] GET /compute/v2.1/os-volumes/a81c6cf7-de15-4059-bf60-4b890aab1bf3 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:38.596036 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-81ec6cbb-1fcd-4157-bc52-4f552fb25682 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:38.598269 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-81ec6cbb-1fcd-4157-bc52-4f552fb25682 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:38.604422 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-81ec6cbb-1fcd-4157-bc52-4f552fb25682 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:38.604877 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-81ec6cbb-1fcd-4157-bc52-4f552fb25682 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:38.605679 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-81ec6cbb-1fcd-4157-bc52-4f552fb25682 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:38.606115 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-81ec6cbb-1fcd-4157-bc52-4f552fb25682 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:38.623542 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:38.640286 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-81ec6cbb-1fcd-4157-bc52-4f552fb25682 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.226214 Jul 29 11:51:38.641064 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 296/608] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:51:38 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments => generated 197 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:39.014777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4885f0c1-fdcf-4d59-9f78-3fc1fee0a624 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:39.015425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-4885f0c1-fdcf-4d59-9f78-3fc1fee0a624 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:39.021459 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4885f0c1-fdcf-4d59-9f78-3fc1fee0a624 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:39.021934 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4885f0c1-fdcf-4d59-9f78-3fc1fee0a624 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:39.022695 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4885f0c1-fdcf-4d59-9f78-3fc1fee0a624 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:39.023129 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4885f0c1-fdcf-4d59-9f78-3fc1fee0a624 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:39.151095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4885f0c1-fdcf-4d59-9f78-3fc1fee0a624 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:39.158988 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4885f0c1-fdcf-4d59-9f78-3fc1fee0a624 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:39.160488 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4885f0c1-fdcf-4d59-9f78-3fc1fee0a624 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:39.161691 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-4885f0c1-fdcf-4d59-9f78-3fc1fee0a624 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.151180 Jul 29 11:51:39.162244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 313/609] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:39 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:51:39.653561 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6e053438-52e4-4c11-b711-5e43917ed7a3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:39.655750 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6e053438-52e4-4c11-b711-5e43917ed7a3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:39.662426 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6e053438-52e4-4c11-b711-5e43917ed7a3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:39.662916 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6e053438-52e4-4c11-b711-5e43917ed7a3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:39.663686 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6e053438-52e4-4c11-b711-5e43917ed7a3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:39.664156 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6e053438-52e4-4c11-b711-5e43917ed7a3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:39.693212 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6e053438-52e4-4c11-b711-5e43917ed7a3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Jul 29 11:51:39.693810 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 297/610] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:51:39 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:39.732904 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-014d6191-61e2-45d8-b7f8-f160dfb6dd9e tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] Calling method '.version_select at 0x7f68fa0d9670>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:39.781457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-014d6191-61e2-45d8-b7f8-f160dfb6dd9e tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b601b0f8-34a4-4f39-b619-65fdb99a767d" status: 200 len: 350 microversion: 2.1 time: 0.052342 Jul 29 11:51:39.782033 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 314/611] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:51:39 2022] GET /compute/v2.1/os-volumes/b601b0f8-34a4-4f39-b619-65fdb99a767d => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:39.795519 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-53627f60-0d6f-4928-8c53-3f18224f8443 tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] Calling method '.version_select at 0x7f68f9ff35e0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:39.876002 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-53627f60-0d6f-4928-8c53-3f18224f8443 tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.084347 Jul 29 11:51:39.876596 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 298/612] 10.222.0.60 () {58 vars in 1134 bytes} [Fri Jul 29 11:51:39 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:39.891110 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4bb46be1-c1bf-4a96-898b-1f3c211750a4 tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] Calling method '.version_select at 0x7f68fa104a60>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:39.972276 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-4bb46be1-c1bf-4a96-898b-1f3c211750a4 tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.084875 Jul 29 11:51:39.972852 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 315/613] 10.222.0.60 () {58 vars in 1149 bytes} [Fri Jul 29 11:51:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:39.985901 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-3c693937-26eb-4ead-a4ce-a8e6edb040b1 tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] Calling method '.version_select at 0x7f68f9f01af0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:40.066453 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-3c693937-26eb-4ead-a4ce-a8e6edb040b1 tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.084263 Jul 29 11:51:40.067048 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 299/614] 10.222.0.60 () {58 vars in 1134 bytes} [Fri Jul 29 11:51:39 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:40.080198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f1d3488e-c9f0-4373-ac90-54b2834bec7e tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] Calling method '.version_select at 0x7f68f9f6b700>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:40.163698 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f1d3488e-c9f0-4373-ac90-54b2834bec7e tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087180 Jul 29 11:51:40.164362 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 316/615] 10.222.0.60 () {58 vars in 1167 bytes} [Fri Jul 29 11:51:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:40.177452 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-969b4451-5a0b-4133-b9e4-4310e9db37ea tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] Calling method '.version_select at 0x7f68f9f380d0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:40.184792 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b20fbde0-706f-4efd-8573-512ef4d4600a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:40.185443 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b20fbde0-706f-4efd-8573-512ef4d4600a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:40.191829 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b20fbde0-706f-4efd-8573-512ef4d4600a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:40.192278 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b20fbde0-706f-4efd-8573-512ef4d4600a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:40.193069 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b20fbde0-706f-4efd-8573-512ef4d4600a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:40.193901 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b20fbde0-706f-4efd-8573-512ef4d4600a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:40.261598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-969b4451-5a0b-4133-b9e4-4310e9db37ea tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088015 Jul 29 11:51:40.262176 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 300/616] 10.222.0.60 () {58 vars in 1170 bytes} [Fri Jul 29 11:51:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:40.275040 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a03c2bbf-14da-42fe-af0a-ef2635b15aa3 tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] Calling method '.version_select at 0x7f68f9ef7ca0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:40.328384 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b20fbde0-706f-4efd-8573-512ef4d4600a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:40.336583 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b20fbde0-706f-4efd-8573-512ef4d4600a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:40.338685 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b20fbde0-706f-4efd-8573-512ef4d4600a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:40.339854 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b20fbde0-706f-4efd-8573-512ef4d4600a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.159777 Jul 29 11:51:40.340407 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 317/617] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:40 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:51:40.361303 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a03c2bbf-14da-42fe-af0a-ef2635b15aa3 tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.089841 Jul 29 11:51:40.361952 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 301/618] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Jul 29 11:51:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:51:40.374700 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-89b1b2a6-36b6-46fe-9a4e-b478a244430c tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] Calling method '.version_select at 0x7f68f9f9b040>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:40.455773 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-89b1b2a6-36b6-46fe-9a4e-b478a244430c tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084756 Jul 29 11:51:40.456341 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 318/619] 10.222.0.60 () {58 vars in 1188 bytes} [Fri Jul 29 11:51:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:40.469205 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-06f81882-a7ac-4622-a51f-a5ae78926317 tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] Calling method '.version_select at 0x7f68f9f01af0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:40.551145 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-06f81882-a7ac-4622-a51f-a5ae78926317 tempest-VolumesTestJSON-1186369890 tempest-VolumesTestJSON-1186369890-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.085644 Jul 29 11:51:40.551720 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 302/620] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Jul 29 11:51:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:40.706089 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d7a0e8ec-71a7-4d35-b125-4c706d4d9464 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:40.708277 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d7a0e8ec-71a7-4d35-b125-4c706d4d9464 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:40.716294 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d7a0e8ec-71a7-4d35-b125-4c706d4d9464 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:40.716750 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d7a0e8ec-71a7-4d35-b125-4c706d4d9464 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:40.717552 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d7a0e8ec-71a7-4d35-b125-4c706d4d9464 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:40.718013 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d7a0e8ec-71a7-4d35-b125-4c706d4d9464 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:40.746589 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d7a0e8ec-71a7-4d35-b125-4c706d4d9464 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044540 Jul 29 11:51:40.747221 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 319/621] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:51:40 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:41.363771 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-134ce36a-9b61-40ee-aa0f-4a86bd101d42 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:41.364902 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-134ce36a-9b61-40ee-aa0f-4a86bd101d42 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:41.371183 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-134ce36a-9b61-40ee-aa0f-4a86bd101d42 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:41.371638 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-134ce36a-9b61-40ee-aa0f-4a86bd101d42 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:41.372401 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-134ce36a-9b61-40ee-aa0f-4a86bd101d42 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:41.372839 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-134ce36a-9b61-40ee-aa0f-4a86bd101d42 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:41.499889 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-134ce36a-9b61-40ee-aa0f-4a86bd101d42 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:41.507728 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-134ce36a-9b61-40ee-aa0f-4a86bd101d42 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:41.509212 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-134ce36a-9b61-40ee-aa0f-4a86bd101d42 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:41.511289 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-134ce36a-9b61-40ee-aa0f-4a86bd101d42 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.151862 Jul 29 11:51:41.511850 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 303/622] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:41 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:51:41.758859 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-264b8bdb-9d5d-4c86-a693-ff9db4413dfb tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:41.761624 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-264b8bdb-9d5d-4c86-a693-ff9db4413dfb tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:41.768824 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-264b8bdb-9d5d-4c86-a693-ff9db4413dfb tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:41.769291 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-264b8bdb-9d5d-4c86-a693-ff9db4413dfb tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:41.770277 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-264b8bdb-9d5d-4c86-a693-ff9db4413dfb tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:41.770736 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-264b8bdb-9d5d-4c86-a693-ff9db4413dfb tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:41.805705 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-264b8bdb-9d5d-4c86-a693-ff9db4413dfb tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050879 Jul 29 11:51:41.806274 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 320/623] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:51:41 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:42.407168 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-b0d7dd73-894e-472c-bec7-2390cd93beed tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:42.407793 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-b0d7dd73-894e-472c-bec7-2390cd93beed tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:42.414307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b0d7dd73-894e-472c-bec7-2390cd93beed tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:42.414762 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b0d7dd73-894e-472c-bec7-2390cd93beed tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:42.415533 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b0d7dd73-894e-472c-bec7-2390cd93beed tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:42.416027 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b0d7dd73-894e-472c-bec7-2390cd93beed tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:42.534229 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6bb76eaa-68fc-482f-b360-91a9d4f378f9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:42.534846 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6bb76eaa-68fc-482f-b360-91a9d4f378f9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:42.540848 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6bb76eaa-68fc-482f-b360-91a9d4f378f9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:42.541961 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6bb76eaa-68fc-482f-b360-91a9d4f378f9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:42.542735 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6bb76eaa-68fc-482f-b360-91a9d4f378f9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:42.543175 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6bb76eaa-68fc-482f-b360-91a9d4f378f9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:42.548075 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-b0d7dd73-894e-472c-bec7-2390cd93beed tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:42.556939 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-b0d7dd73-894e-472c-bec7-2390cd93beed tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1594 microversion: 2.1 time: 0.153421 Jul 29 11:51:42.557618 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 304/624] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:42 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:42.683430 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6bb76eaa-68fc-482f-b360-91a9d4f378f9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:42.692799 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6bb76eaa-68fc-482f-b360-91a9d4f378f9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:42.695374 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6bb76eaa-68fc-482f-b360-91a9d4f378f9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:42.696868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-6bb76eaa-68fc-482f-b360-91a9d4f378f9 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.166747 Jul 29 11:51:42.698888 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 321/625] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:42 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:51:42.817708 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5ede8168-8dfd-46c1-a1f9-3c1fcce27194 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:42.820951 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-5ede8168-8dfd-46c1-a1f9-3c1fcce27194 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:42.832725 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5ede8168-8dfd-46c1-a1f9-3c1fcce27194 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:42.832725 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5ede8168-8dfd-46c1-a1f9-3c1fcce27194 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:42.833361 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5ede8168-8dfd-46c1-a1f9-3c1fcce27194 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:42.833853 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5ede8168-8dfd-46c1-a1f9-3c1fcce27194 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:42.866151 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-5ede8168-8dfd-46c1-a1f9-3c1fcce27194 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052655 Jul 29 11:51:42.866727 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 305/626] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:51:42 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:43.721635 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d8d495c7-532e-44d3-8e8c-88770a00c8bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:43.722253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d8d495c7-532e-44d3-8e8c-88770a00c8bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:43.729745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d8d495c7-532e-44d3-8e8c-88770a00c8bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:43.730621 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d8d495c7-532e-44d3-8e8c-88770a00c8bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:43.731516 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d8d495c7-532e-44d3-8e8c-88770a00c8bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:43.732061 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d8d495c7-532e-44d3-8e8c-88770a00c8bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:43.879283 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8139c56c-9c2c-4b99-a273-4120654c9550 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:43.881410 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8139c56c-9c2c-4b99-a273-4120654c9550 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:43.888598 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8139c56c-9c2c-4b99-a273-4120654c9550 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:43.889055 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8139c56c-9c2c-4b99-a273-4120654c9550 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:43.889890 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8139c56c-9c2c-4b99-a273-4120654c9550 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:43.890306 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8139c56c-9c2c-4b99-a273-4120654c9550 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:43.919939 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8139c56c-9c2c-4b99-a273-4120654c9550 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044675 Jul 29 11:51:43.920507 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 306/627] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:51:43 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 29 11:51:43.984425 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-05c71a11-aae7-489f-9621-bef694f94f0f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:43.985044 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-05c71a11-aae7-489f-9621-bef694f94f0f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:43.991757 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-05c71a11-aae7-489f-9621-bef694f94f0f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:43.992227 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-05c71a11-aae7-489f-9621-bef694f94f0f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:43.993033 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-05c71a11-aae7-489f-9621-bef694f94f0f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:43.993504 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-05c71a11-aae7-489f-9621-bef694f94f0f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:44.012379 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d8d495c7-532e-44d3-8e8c-88770a00c8bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:44.021096 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-05c71a11-aae7-489f-9621-bef694f94f0f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Going to try to terminate instance {{(pid=129585) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:51:44.023473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d8d495c7-532e-44d3-8e8c-88770a00c8bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:44.025055 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d8d495c7-532e-44d3-8e8c-88770a00c8bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:44.026800 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d8d495c7-532e-44d3-8e8c-88770a00c8bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.309109 Jul 29 11:51:44.027356 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 322/628] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:43 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:51:44.111443 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-05c71a11-aae7-489f-9621-bef694f94f0f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "DELETE /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 204 len: 0 microversion: 2.1 time: 0.130319 Jul 29 11:51:44.112239 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 307/629] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:51:43 2022] DELETE /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 11:51:44.122579 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4d0811c7-eed9-496f-a0ad-3c554b25bb8f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:44.123469 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-4d0811c7-eed9-496f-a0ad-3c554b25bb8f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:44.130388 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4d0811c7-eed9-496f-a0ad-3c554b25bb8f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:44.130926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4d0811c7-eed9-496f-a0ad-3c554b25bb8f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:44.131959 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4d0811c7-eed9-496f-a0ad-3c554b25bb8f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:44.132609 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4d0811c7-eed9-496f-a0ad-3c554b25bb8f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:44.622218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4d0811c7-eed9-496f-a0ad-3c554b25bb8f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:44.629730 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-4d0811c7-eed9-496f-a0ad-3c554b25bb8f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1679 microversion: 2.1 time: 0.512530 Jul 29 11:51:44.630221 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 323/630] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:44 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1679 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:44.921110 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-85762d6f-260f-418f-8e8a-8016992bcb96 req-fc3b658e-1337-44b7-b53b-e1fba7faeff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f49b2279-4842-4a6c-8dc4-c3429b36f44b", "tag": "60afe5bb-47c8-40c1-8b64-67d4e2f7c626"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:44.931556 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-85762d6f-260f-418f-8e8a-8016992bcb96 req-fc3b658e-1337-44b7-b53b-e1fba7faeff4 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:44.932526 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-85762d6f-260f-418f-8e8a-8016992bcb96 req-fc3b658e-1337-44b7-b53b-e1fba7faeff4 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:44.945342 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-85762d6f-260f-418f-8e8a-8016992bcb96 req-fc3b658e-1337-44b7-b53b-e1fba7faeff4 service nova] Creating event network-changed:60afe5bb-47c8-40c1-8b64-67d4e2f7c626 for instance f49b2279-4842-4a6c-8dc4-c3429b36f44b on hv-cinder-83754 Jul 29 11:51:44.951765 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-85762d6f-260f-418f-8e8a-8016992bcb96 req-fc3b658e-1337-44b7-b53b-e1fba7faeff4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036723 Jul 29 11:51:44.956725 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 308/631] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:45.053779 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-359642e0-dfd3-475e-b3b3-0ed1c6ddc16c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:45.055448 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-359642e0-dfd3-475e-b3b3-0ed1c6ddc16c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:45.064911 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-359642e0-dfd3-475e-b3b3-0ed1c6ddc16c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:45.066213 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-359642e0-dfd3-475e-b3b3-0ed1c6ddc16c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:45.067699 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-359642e0-dfd3-475e-b3b3-0ed1c6ddc16c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:45.068332 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-359642e0-dfd3-475e-b3b3-0ed1c6ddc16c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:45.240416 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-359642e0-dfd3-475e-b3b3-0ed1c6ddc16c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:45.250585 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-359642e0-dfd3-475e-b3b3-0ed1c6ddc16c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:45.252159 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-359642e0-dfd3-475e-b3b3-0ed1c6ddc16c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:45.253356 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-359642e0-dfd3-475e-b3b3-0ed1c6ddc16c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.205892 Jul 29 11:51:45.254264 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 324/632] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:45 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:51:45.652798 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-cd46049d-a807-43eb-9052-085ef0af7239 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:45.653541 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-cd46049d-a807-43eb-9052-085ef0af7239 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:45.661836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cd46049d-a807-43eb-9052-085ef0af7239 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:45.668549 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cd46049d-a807-43eb-9052-085ef0af7239 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:45.670289 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cd46049d-a807-43eb-9052-085ef0af7239 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:45.670983 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cd46049d-a807-43eb-9052-085ef0af7239 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:45.879937 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-cd46049d-a807-43eb-9052-085ef0af7239 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:45.893168 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-cd46049d-a807-43eb-9052-085ef0af7239 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1679 microversion: 2.1 time: 0.245031 Jul 29 11:51:45.897359 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 309/633] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:45 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1679 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:46.202709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1888453c-0620-485b-af51-461cdff6bab5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1058753378"}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:46.203400 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-1888453c-0620-485b-af51-461cdff6bab5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:46.210812 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1888453c-0620-485b-af51-461cdff6bab5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:46.211269 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1888453c-0620-485b-af51-461cdff6bab5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:46.212079 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1888453c-0620-485b-af51-461cdff6bab5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:46.212517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1888453c-0620-485b-af51-461cdff6bab5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:46.277061 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a2801c85-2e93-41bc-aee2-0b56c6902460 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:46.277781 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a2801c85-2e93-41bc-aee2-0b56c6902460 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:46.288520 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a2801c85-2e93-41bc-aee2-0b56c6902460 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:46.289023 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a2801c85-2e93-41bc-aee2-0b56c6902460 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:46.289853 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a2801c85-2e93-41bc-aee2-0b56c6902460 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:46.290295 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a2801c85-2e93-41bc-aee2-0b56c6902460 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:46.413979 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.network.security_group_api [None req-1888453c-0620-485b-af51-461cdff6bab5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Adding security group a9cd8a1e-b7a0-41a6-b6a4-49419d7a3530 to port 60afe5bb-47c8-40c1-8b64-67d4e2f7c626 Jul 29 11:51:46.587249 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a2801c85-2e93-41bc-aee2-0b56c6902460 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:46.598179 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a2801c85-2e93-41bc-aee2-0b56c6902460 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:46.600049 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a2801c85-2e93-41bc-aee2-0b56c6902460 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:46.601529 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a2801c85-2e93-41bc-aee2-0b56c6902460 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.329356 Jul 29 11:51:46.602299 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 310/634] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:46 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:51:46.921788 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-45c62869-c0c1-4a10-a581-8a452bf38bf2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:46.923490 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-45c62869-c0c1-4a10-a581-8a452bf38bf2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:46.936167 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-45c62869-c0c1-4a10-a581-8a452bf38bf2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:46.939094 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-45c62869-c0c1-4a10-a581-8a452bf38bf2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:46.941281 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-45c62869-c0c1-4a10-a581-8a452bf38bf2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:46.942807 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-45c62869-c0c1-4a10-a581-8a452bf38bf2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:46.965325 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1888453c-0620-485b-af51-461cdff6bab5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "POST /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/action" status: 202 len: 0 microversion: 2.1 time: 0.766791 Jul 29 11:51:46.966265 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 325/635] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Jul 29 11:51:46 2022] POST /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/action => generated 0 bytes in 770 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:51:46.975494 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-eb6ca4ce-603c-4277-8df1-d82d4548f0a5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:46.978266 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-eb6ca4ce-603c-4277-8df1-d82d4548f0a5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:47.004286 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-eb6ca4ce-603c-4277-8df1-d82d4548f0a5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:47.006689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-eb6ca4ce-603c-4277-8df1-d82d4548f0a5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:47.012629 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-eb6ca4ce-603c-4277-8df1-d82d4548f0a5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:47.013497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-eb6ca4ce-603c-4277-8df1-d82d4548f0a5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:47.383653 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-45c62869-c0c1-4a10-a581-8a452bf38bf2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:47.397887 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-45c62869-c0c1-4a10-a581-8a452bf38bf2 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 200 len: 1679 microversion: 2.1 time: 0.483968 Jul 29 11:51:47.398468 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 311/636] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:46 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 1679 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:47.415248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-eb6ca4ce-603c-4277-8df1-d82d4548f0a5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:47.416417 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-bf12cead-d0c0-4b6c-9d1d-f846b25de0d9 req-cc2c90fb-8b4e-4c2a-9a20-80ddbaee817b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f49b2279-4842-4a6c-8dc4-c3429b36f44b", "tag": "60afe5bb-47c8-40c1-8b64-67d4e2f7c626"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:47.427616 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-bf12cead-d0c0-4b6c-9d1d-f846b25de0d9 req-cc2c90fb-8b4e-4c2a-9a20-80ddbaee817b service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:47.428346 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-bf12cead-d0c0-4b6c-9d1d-f846b25de0d9 req-cc2c90fb-8b4e-4c2a-9a20-80ddbaee817b service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:47.439610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-eb6ca4ce-603c-4277-8df1-d82d4548f0a5 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1760 microversion: 2.1 time: 0.468826 Jul 29 11:51:47.440202 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 326/637] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:46 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1760 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:47.459736 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-bf12cead-d0c0-4b6c-9d1d-f846b25de0d9 req-cc2c90fb-8b4e-4c2a-9a20-80ddbaee817b service nova] Creating event network-changed:60afe5bb-47c8-40c1-8b64-67d4e2f7c626 for instance f49b2279-4842-4a6c-8dc4-c3429b36f44b on hv-cinder-83754 Jul 29 11:51:47.466260 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-bf12cead-d0c0-4b6c-9d1d-f846b25de0d9 req-cc2c90fb-8b4e-4c2a-9a20-80ddbaee817b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066393 Jul 29 11:51:47.467085 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 312/638] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:47.605370 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-eed384ec-efce-4ccd-919f-df83cf8faf40 req-81a37da5-16c3-4542-aebe-b9899627124c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439cbe53-546a-4902-a4e7-c25b4a7b84d0", "name": "network-vif-deleted", "tag": "df601806-d30d-4808-ad00-6cb495f89154"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:47.625436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-15241054-e5c8-4a49-886f-50f9a7bcdf21 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:47.626764 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-15241054-e5c8-4a49-886f-50f9a7bcdf21 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:47.642849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-eed384ec-efce-4ccd-919f-df83cf8faf40 req-81a37da5-16c3-4542-aebe-b9899627124c service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:47.643812 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-eed384ec-efce-4ccd-919f-df83cf8faf40 req-81a37da5-16c3-4542-aebe-b9899627124c service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:47.648793 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-15241054-e5c8-4a49-886f-50f9a7bcdf21 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:47.649305 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-15241054-e5c8-4a49-886f-50f9a7bcdf21 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:47.650361 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-15241054-e5c8-4a49-886f-50f9a7bcdf21 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:47.650930 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-15241054-e5c8-4a49-886f-50f9a7bcdf21 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:47.662916 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-eed384ec-efce-4ccd-919f-df83cf8faf40 req-81a37da5-16c3-4542-aebe-b9899627124c service nova] Creating event network-vif-deleted:df601806-d30d-4808-ad00-6cb495f89154 for instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 on hv-cinder-83754 Jul 29 11:51:47.683408 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-eed384ec-efce-4ccd-919f-df83cf8faf40 req-81a37da5-16c3-4542-aebe-b9899627124c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082153 Jul 29 11:51:47.687312 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 327/639] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:47.863074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-15241054-e5c8-4a49-886f-50f9a7bcdf21 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:47.871624 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-15241054-e5c8-4a49-886f-50f9a7bcdf21 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:47.873126 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-15241054-e5c8-4a49-886f-50f9a7bcdf21 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:47.874326 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-15241054-e5c8-4a49-886f-50f9a7bcdf21 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.253266 Jul 29 11:51:47.874909 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 313/640] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:47 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:51:48.420374 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-616181cd-4d71-49a4-8495-bf276334c1d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:48.421401 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-616181cd-4d71-49a4-8495-bf276334c1d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:48.428222 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-616181cd-4d71-49a4-8495-bf276334c1d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:48.428932 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-616181cd-4d71-49a4-8495-bf276334c1d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:48.429979 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-616181cd-4d71-49a4-8495-bf276334c1d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:48.430778 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-616181cd-4d71-49a4-8495-bf276334c1d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:48.446845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-616181cd-4d71-49a4-8495-bf276334c1d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] HTTP exception thrown: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-616181cd-4d71-49a4-8495-bf276334c1d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Request method failure captured: Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 HTTP/1.1 Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48icVbGQpo_IdH8_u62UoQcPfoUo3xwllOW7fjakcJXUphVjQAJzVqE7fI-fsqP3g4NqZjz8YFLyejjO-VLv92lJBWa3RdJ2AtZ841GWsHIbm-PB-ZcSKgDGNNp_FYxiDV5ReNSeL7mFuVa5RErCcpxqZKkcIeuKO_mbw7bKo_jOIw8 Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:51:48.449134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:51:48.450586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4b9969357142bc8724804eb47e0c48", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:51:48.450586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:51:48.450586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:51:48.450586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:51:48.450586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:51:48.450586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:51:48.450586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:51:48.450586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 1a343996462b462d86fb89b876f4e127 Jul 29 11:51:48.450586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:51:48.450586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:51:48.450586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. Jul 29 11:51:48.450586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '439cbe53-546a-4902-a4e7-c25b4a7b84d0'} Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:51:48.451517 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. Jul 29 11:51:48.453042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:51:48.455251 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-616181cd-4d71-49a4-8495-bf276334c1d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Returning 404 to user: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:51:48.456274 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-616181cd-4d71-49a4-8495-bf276334c1d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 404 len: 111 microversion: 2.1 time: 0.041272 Jul 29 11:51:48.457320 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 328/641] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:48 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:51:48.465630 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-648a23cc-082f-49d8-8ece-086b47b2b447 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '.version_select at 0x7f68f9ff3940>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:48.490271 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-648a23cc-082f-49d8-8ece-086b47b2b447 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-703280080" status: 202 len: 0 microversion: 2.1 time: 0.028570 Jul 29 11:51:48.491355 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 314/642] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Jul 29 11:51:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-703280080 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:51:48.898298 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-a7cd58d0-d502-48ae-b458-2b8c4a4fa292 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:48.898916 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-a7cd58d0-d502-48ae-b458-2b8c4a4fa292 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:48.906382 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a7cd58d0-d502-48ae-b458-2b8c4a4fa292 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:48.907081 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a7cd58d0-d502-48ae-b458-2b8c4a4fa292 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:48.907861 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a7cd58d0-d502-48ae-b458-2b8c4a4fa292 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:48.908296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a7cd58d0-d502-48ae-b458-2b8c4a4fa292 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:48.912659 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:49.119066 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a7cd58d0-d502-48ae-b458-2b8c4a4fa292 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:49.126941 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a7cd58d0-d502-48ae-b458-2b8c4a4fa292 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:49.128431 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a7cd58d0-d502-48ae-b458-2b8c4a4fa292 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:49.129628 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-a7cd58d0-d502-48ae-b458-2b8c4a4fa292 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.235359 Jul 29 11:51:49.130199 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 329/643] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:48 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:51:49.296327 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4439d7b9-0ec2-4a3f-823e-43be2016d30a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Action: 'create', calling method: .version_select at 0x7f68f9f01280>, body: {"keypair": {"name": "tempest-keypair-1408142609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7Caj4N0DmCB9J/2Dd+2ihM8RtKyXY7YdHgxkVrwwmujZhZUrg3rMdq2bXFbDRYUKN6xgIS3A5ctPmum5+1RCaFSKobuHdxZdJ8BGUkT6uQA4KLRD2EcClNvs618aCTAw=="}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:49.312143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-4439d7b9-0ec2-4a3f-823e-43be2016d30a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Getting quotas for project 6a4b9969357142bc8724804eb47e0c48. Resources: {'key_pairs'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:51:49.315950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-4439d7b9-0ec2-4a3f-823e-43be2016d30a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Getting quotas for user 1a343996462b462d86fb89b876f4e127 and project 6a4b9969357142bc8724804eb47e0c48. Resources: {'key_pairs'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:51:49.337013 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4439d7b9-0ec2-4a3f-823e-43be2016d30a tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044653 Jul 29 11:51:49.338126 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 315/644] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Jul 29 11:51:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:51:50.153404 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e0d1d621-6112-4035-92b2-0f61f0f2651f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:50.154300 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e0d1d621-6112-4035-92b2-0f61f0f2651f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:50.167135 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e0d1d621-6112-4035-92b2-0f61f0f2651f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:50.167725 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e0d1d621-6112-4035-92b2-0f61f0f2651f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:50.168645 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e0d1d621-6112-4035-92b2-0f61f0f2651f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:50.169089 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e0d1d621-6112-4035-92b2-0f61f0f2651f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:50.360786 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e0d1d621-6112-4035-92b2-0f61f0f2651f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:50.369931 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e0d1d621-6112-4035-92b2-0f61f0f2651f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:50.371755 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e0d1d621-6112-4035-92b2-0f61f0f2651f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:50.372951 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e0d1d621-6112-4035-92b2-0f61f0f2651f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.224055 Jul 29 11:51:50.373533 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 330/645] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:50 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:51:50.749321 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-63b1ef01-eb01-4714-87c5-7b63e551694b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1888488758", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8c1956d-5393-448f-8fc5-93aafd4768ba"}], "security_groups": [{"name": "tempest-securitygroup--1539820919"}], "key_name": "tempest-keypair-1408142609", "user_data": "}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:50.856583 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.network.neutron [None req-63b1ef01-eb01-4714-87c5-7b63e551694b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] validate_networks() for [('b8c1956d-5393-448f-8fc5-93aafd4768ba', None, None, None, None, None)] {{(pid=129585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:51:51.266376 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-63b1ef01-eb01-4714-87c5-7b63e551694b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Flavor limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:51:51.266796 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-63b1ef01-eb01-4714-87c5-7b63e551694b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Image limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:51:51.267266 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-63b1ef01-eb01-4714-87c5-7b63e551694b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Flavor pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:51:51.267669 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-63b1ef01-eb01-4714-87c5-7b63e551694b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Image pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:51:51.268075 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-63b1ef01-eb01-4714-87c5-7b63e551694b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:51:51.277076 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-63b1ef01-eb01-4714-87c5-7b63e551694b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:51.277559 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-63b1ef01-eb01-4714-87c5-7b63e551694b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:51.278341 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-63b1ef01-eb01-4714-87c5-7b63e551694b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:51.278770 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-63b1ef01-eb01-4714-87c5-7b63e551694b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:51.295612 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-63b1ef01-eb01-4714-87c5-7b63e551694b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Getting quotas for project 6a4b9969357142bc8724804eb47e0c48. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:51:51.299437 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-63b1ef01-eb01-4714-87c5-7b63e551694b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Getting quotas for user 1a343996462b462d86fb89b876f4e127 and project 6a4b9969357142bc8724804eb47e0c48. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:51:51.310608 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-63b1ef01-eb01-4714-87c5-7b63e551694b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Going to run 1 instances... {{(pid=129585) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:51:51.312804 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-63b1ef01-eb01-4714-87c5-7b63e551694b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:51:51.357574 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-63b1ef01-eb01-4714-87c5-7b63e551694b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.614672 Jul 29 11:51:51.358202 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 316/646] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:51:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 11:51:51.369391 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-0a4b5067-ae5b-4e53-8edb-fd83ece4b81d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:51.370055 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-0a4b5067-ae5b-4e53-8edb-fd83ece4b81d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:51.397402 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-032ab3c5-4fdc-4324-9175-2c65a47ae8db tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:51.398049 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-032ab3c5-4fdc-4324-9175-2c65a47ae8db tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:51.406712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-032ab3c5-4fdc-4324-9175-2c65a47ae8db tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:51.406712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-032ab3c5-4fdc-4324-9175-2c65a47ae8db tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:51.406712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-032ab3c5-4fdc-4324-9175-2c65a47ae8db tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:51.406712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-032ab3c5-4fdc-4324-9175-2c65a47ae8db tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:51.439842 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-0a4b5067-ae5b-4e53-8edb-fd83ece4b81d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:51.449346 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-0a4b5067-ae5b-4e53-8edb-fd83ece4b81d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 200 len: 1242 microversion: 2.1 time: 0.083693 Jul 29 11:51:51.449962 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 331/647] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:51 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:51.540826 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-032ab3c5-4fdc-4324-9175-2c65a47ae8db tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:51.548789 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-032ab3c5-4fdc-4324-9175-2c65a47ae8db tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:51.550317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-032ab3c5-4fdc-4324-9175-2c65a47ae8db tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:51.551476 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-032ab3c5-4fdc-4324-9175-2c65a47ae8db tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.159382 Jul 29 11:51:51.552035 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 317/648] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:51 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:51:52.469205 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-dd448b63-1db7-44e9-9714-d09ed774e5b1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:52.469880 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-dd448b63-1db7-44e9-9714-d09ed774e5b1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:52.476961 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dd448b63-1db7-44e9-9714-d09ed774e5b1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:52.477530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dd448b63-1db7-44e9-9714-d09ed774e5b1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:52.478863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dd448b63-1db7-44e9-9714-d09ed774e5b1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:52.479376 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dd448b63-1db7-44e9-9714-d09ed774e5b1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:52.549837 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-dd448b63-1db7-44e9-9714-d09ed774e5b1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:52.557826 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-dd448b63-1db7-44e9-9714-d09ed774e5b1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 200 len: 1302 microversion: 2.1 time: 0.092341 Jul 29 11:51:52.577813 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-133880bf-65ec-4e82-a867-01007876a0d8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:52.578352 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-133880bf-65ec-4e82-a867-01007876a0d8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:52.581591 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 332/649] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:52 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 1302 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:52.584891 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-133880bf-65ec-4e82-a867-01007876a0d8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:52.585444 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-133880bf-65ec-4e82-a867-01007876a0d8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:52.586322 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-133880bf-65ec-4e82-a867-01007876a0d8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:52.586854 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-133880bf-65ec-4e82-a867-01007876a0d8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:52.730424 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-133880bf-65ec-4e82-a867-01007876a0d8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:52.739248 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-133880bf-65ec-4e82-a867-01007876a0d8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:52.740909 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-133880bf-65ec-4e82-a867-01007876a0d8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:52.742105 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-133880bf-65ec-4e82-a867-01007876a0d8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.168467 Jul 29 11:51:52.742666 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 318/650] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:52 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:51:53.581990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-2fee8ba3-0f10-4881-9f98-0c33be2a0757 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:53.582843 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-2fee8ba3-0f10-4881-9f98-0c33be2a0757 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:53.594151 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2fee8ba3-0f10-4881-9f98-0c33be2a0757 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:53.594679 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2fee8ba3-0f10-4881-9f98-0c33be2a0757 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:53.595966 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2fee8ba3-0f10-4881-9f98-0c33be2a0757 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:53.596549 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2fee8ba3-0f10-4881-9f98-0c33be2a0757 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:53.745444 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2fee8ba3-0f10-4881-9f98-0c33be2a0757 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:53.753934 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-2fee8ba3-0f10-4881-9f98-0c33be2a0757 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 200 len: 1368 microversion: 2.1 time: 0.177839 Jul 29 11:51:53.754742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 333/651] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:53 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:53.767120 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-120463d1-9a44-4858-b917-ad996cf13b54 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:53.768402 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-120463d1-9a44-4858-b917-ad996cf13b54 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:53.776972 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-120463d1-9a44-4858-b917-ad996cf13b54 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:53.777729 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-120463d1-9a44-4858-b917-ad996cf13b54 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:53.778725 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-120463d1-9a44-4858-b917-ad996cf13b54 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:53.779256 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-120463d1-9a44-4858-b917-ad996cf13b54 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:53.926214 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-120463d1-9a44-4858-b917-ad996cf13b54 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:53.936904 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-120463d1-9a44-4858-b917-ad996cf13b54 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:53.939297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-120463d1-9a44-4858-b917-ad996cf13b54 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:53.941575 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-120463d1-9a44-4858-b917-ad996cf13b54 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1745 microversion: 2.20 time: 0.178287 Jul 29 11:51:53.942142 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 319/652] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:53 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:51:54.156981 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-c5276754-4d28-4822-958b-812ff01d76a7 req-33b6da75-9ce1-48b2-ba28-cfc1cb1f1596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "472c7a09-0157-404d-bd35-d765fd6baed6", "tag": "3d57aa09-a07c-4b2f-a69b-70042434670c"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:54.172545 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-c5276754-4d28-4822-958b-812ff01d76a7 req-33b6da75-9ce1-48b2-ba28-cfc1cb1f1596 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:54.173123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-c5276754-4d28-4822-958b-812ff01d76a7 req-33b6da75-9ce1-48b2-ba28-cfc1cb1f1596 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:54.188564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-c5276754-4d28-4822-958b-812ff01d76a7 req-33b6da75-9ce1-48b2-ba28-cfc1cb1f1596 service nova] Creating event network-changed:3d57aa09-a07c-4b2f-a69b-70042434670c for instance 472c7a09-0157-404d-bd35-d765fd6baed6 on hv-cinder-83754 Jul 29 11:51:54.194349 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-c5276754-4d28-4822-958b-812ff01d76a7 req-33b6da75-9ce1-48b2-ba28-cfc1cb1f1596 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041304 Jul 29 11:51:54.195543 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 334/653] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:51:54.777141 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-bdcff28c-956d-46ea-abb1-2b638ff94f0c tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:54.777794 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-bdcff28c-956d-46ea-abb1-2b638ff94f0c tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:54.784413 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bdcff28c-956d-46ea-abb1-2b638ff94f0c tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:54.784945 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bdcff28c-956d-46ea-abb1-2b638ff94f0c tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:54.785760 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bdcff28c-956d-46ea-abb1-2b638ff94f0c tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:54.786200 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bdcff28c-956d-46ea-abb1-2b638ff94f0c tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:54.804929 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:54.928777 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-bdcff28c-956d-46ea-abb1-2b638ff94f0c tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:54.936945 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-bdcff28c-956d-46ea-abb1-2b638ff94f0c tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 200 len: 1368 microversion: 2.1 time: 0.164004 Jul 29 11:51:54.937582 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 320/654] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:54 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:54.968202 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-7e0acee5-6134-4390-8fd4-7ee994aa9e32 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:54.969506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-7e0acee5-6134-4390-8fd4-7ee994aa9e32 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:54.976811 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7e0acee5-6134-4390-8fd4-7ee994aa9e32 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:54.976811 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7e0acee5-6134-4390-8fd4-7ee994aa9e32 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:54.977173 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7e0acee5-6134-4390-8fd4-7ee994aa9e32 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:54.977644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7e0acee5-6134-4390-8fd4-7ee994aa9e32 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:55.111185 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-7e0acee5-6134-4390-8fd4-7ee994aa9e32 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:55.119825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-7e0acee5-6134-4390-8fd4-7ee994aa9e32 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:55.121333 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-7e0acee5-6134-4390-8fd4-7ee994aa9e32 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:55.122528 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-7e0acee5-6134-4390-8fd4-7ee994aa9e32 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1745 microversion: 2.20 time: 0.160044 Jul 29 11:51:55.127313 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 335/655] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:54 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:51:55.959378 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6045fa48-3c42-4c46-bb60-a6c14225032b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:55.961131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6045fa48-3c42-4c46-bb60-a6c14225032b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:55.982993 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6045fa48-3c42-4c46-bb60-a6c14225032b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:55.987242 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6045fa48-3c42-4c46-bb60-a6c14225032b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:55.991412 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6045fa48-3c42-4c46-bb60-a6c14225032b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:55.992309 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6045fa48-3c42-4c46-bb60-a6c14225032b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:56.150602 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-dbea49d9-825a-484b-8fc1-92771b9286b7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:56.151853 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-dbea49d9-825a-484b-8fc1-92771b9286b7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:56.159496 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dbea49d9-825a-484b-8fc1-92771b9286b7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:56.160137 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dbea49d9-825a-484b-8fc1-92771b9286b7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:56.161099 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dbea49d9-825a-484b-8fc1-92771b9286b7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:56.161978 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dbea49d9-825a-484b-8fc1-92771b9286b7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:56.188133 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6045fa48-3c42-4c46-bb60-a6c14225032b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:56.199648 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6045fa48-3c42-4c46-bb60-a6c14225032b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 200 len: 1368 microversion: 2.1 time: 0.244861 Jul 29 11:51:56.200970 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 321/656] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:55 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:56.374636 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-dbea49d9-825a-484b-8fc1-92771b9286b7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:56.384652 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-dbea49d9-825a-484b-8fc1-92771b9286b7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:56.387433 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-dbea49d9-825a-484b-8fc1-92771b9286b7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:56.389962 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-dbea49d9-825a-484b-8fc1-92771b9286b7 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1745 microversion: 2.20 time: 0.243599 Jul 29 11:51:56.391164 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 336/657] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:56 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1745 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:51:57.221510 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-3a697578-b09f-4d21-89ea-452e629e02f1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:57.222980 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-3a697578-b09f-4d21-89ea-452e629e02f1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:57.230901 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3a697578-b09f-4d21-89ea-452e629e02f1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:57.231703 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3a697578-b09f-4d21-89ea-452e629e02f1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:57.232701 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3a697578-b09f-4d21-89ea-452e629e02f1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:57.233483 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3a697578-b09f-4d21-89ea-452e629e02f1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:57.415872 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-dfb18fbb-9df0-4a96-bf38-a7b105fd3672 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:57.416979 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-3a697578-b09f-4d21-89ea-452e629e02f1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:57.421089 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-dfb18fbb-9df0-4a96-bf38-a7b105fd3672 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:57.425141 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-3a697578-b09f-4d21-89ea-452e629e02f1 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 200 len: 1368 microversion: 2.1 time: 0.208093 Jul 29 11:51:57.427767 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 322/658] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:57 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:57.431983 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dfb18fbb-9df0-4a96-bf38-a7b105fd3672 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:57.432859 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dfb18fbb-9df0-4a96-bf38-a7b105fd3672 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:57.435555 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dfb18fbb-9df0-4a96-bf38-a7b105fd3672 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:57.436288 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dfb18fbb-9df0-4a96-bf38-a7b105fd3672 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:57.605446 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-dfb18fbb-9df0-4a96-bf38-a7b105fd3672 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:57.625595 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-dfb18fbb-9df0-4a96-bf38-a7b105fd3672 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:57.627225 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-dfb18fbb-9df0-4a96-bf38-a7b105fd3672 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:57.628647 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-dfb18fbb-9df0-4a96-bf38-a7b105fd3672 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1740 microversion: 2.20 time: 0.216786 Jul 29 11:51:57.629640 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 337/659] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:57 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:51:58.158308 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-ab101936-d3e3-4dc9-ae07-9bb47c41b102 req-58f2839d-ae1a-43c7-aa99-cec2c76beba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b28697-8f3b-4087-ae1b-836eb376d11b", "name": "network-vif-plugged", "status": "completed", "tag": "d99e2239-1b7e-46f6-b919-e3f8a7ca8642"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:51:58.170038 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-ab101936-d3e3-4dc9-ae07-9bb47c41b102 req-58f2839d-ae1a-43c7-aa99-cec2c76beba2 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:58.170805 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-ab101936-d3e3-4dc9-ae07-9bb47c41b102 req-58f2839d-ae1a-43c7-aa99-cec2c76beba2 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:58.186684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-ab101936-d3e3-4dc9-ae07-9bb47c41b102 req-58f2839d-ae1a-43c7-aa99-cec2c76beba2 service nova] Creating event network-vif-plugged:d99e2239-1b7e-46f6-b919-e3f8a7ca8642 for instance 21b28697-8f3b-4087-ae1b-836eb376d11b on hv-cinder-83754 Jul 29 11:51:58.196438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-ab101936-d3e3-4dc9-ae07-9bb47c41b102 req-58f2839d-ae1a-43c7-aa99-cec2c76beba2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040788 Jul 29 11:51:58.197982 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 323/660] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:51:58.457881 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e65c874f-6d78-4206-a504-1cef41281c47 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:58.458901 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e65c874f-6d78-4206-a504-1cef41281c47 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:58.466927 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=61 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:51:58.468685 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e65c874f-6d78-4206-a504-1cef41281c47 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:58.469310 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e65c874f-6d78-4206-a504-1cef41281c47 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:58.470176 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e65c874f-6d78-4206-a504-1cef41281c47 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:58.470565 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e65c874f-6d78-4206-a504-1cef41281c47 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:58.657659 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6ab2d8cd-208f-471c-9814-0b462e0b94d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:58.658368 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6ab2d8cd-208f-471c-9814-0b462e0b94d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:58.669530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6ab2d8cd-208f-471c-9814-0b462e0b94d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:58.670742 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6ab2d8cd-208f-471c-9814-0b462e0b94d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:58.672359 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6ab2d8cd-208f-471c-9814-0b462e0b94d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:58.673014 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6ab2d8cd-208f-471c-9814-0b462e0b94d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:58.676839 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e65c874f-6d78-4206-a504-1cef41281c47 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:58.684592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e65c874f-6d78-4206-a504-1cef41281c47 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 200 len: 1368 microversion: 2.1 time: 0.238800 Jul 29 11:51:58.686620 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 338/661] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:58 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:51:59.231534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6ab2d8cd-208f-471c-9814-0b462e0b94d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:59.241371 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6ab2d8cd-208f-471c-9814-0b462e0b94d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:59.243160 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6ab2d8cd-208f-471c-9814-0b462e0b94d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:59.245133 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6ab2d8cd-208f-471c-9814-0b462e0b94d3 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1740 microversion: 2.20 time: 0.591922 Jul 29 11:51:59.246402 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 324/662] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:51:58 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1740 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:51:59.706777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e1d51bc2-c3d7-4eae-8ae6-0f2d37dcf21d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:51:59.708057 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e1d51bc2-c3d7-4eae-8ae6-0f2d37dcf21d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:51:59.715820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e1d51bc2-c3d7-4eae-8ae6-0f2d37dcf21d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:59.716506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e1d51bc2-c3d7-4eae-8ae6-0f2d37dcf21d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:59.717729 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e1d51bc2-c3d7-4eae-8ae6-0f2d37dcf21d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:51:59.718537 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e1d51bc2-c3d7-4eae-8ae6-0f2d37dcf21d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:51:59.885251 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e1d51bc2-c3d7-4eae-8ae6-0f2d37dcf21d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:51:59.896887 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e1d51bc2-c3d7-4eae-8ae6-0f2d37dcf21d tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 200 len: 1368 microversion: 2.1 time: 0.190616 Jul 29 11:51:59.897602 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 339/663] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:51:59 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:52:00.216717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-25404915-0cb9-4eda-b619-012178352f65 req-762b1e76-30b2-487a-8472-e5d23995434d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "472c7a09-0157-404d-bd35-d765fd6baed6", "name": "network-vif-plugged", "status": "completed", "tag": "3d57aa09-a07c-4b2f-a69b-70042434670c"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:52:00.230798 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-25404915-0cb9-4eda-b619-012178352f65 req-762b1e76-30b2-487a-8472-e5d23995434d service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:00.231581 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-25404915-0cb9-4eda-b619-012178352f65 req-762b1e76-30b2-487a-8472-e5d23995434d service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:00.244036 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-25404915-0cb9-4eda-b619-012178352f65 req-762b1e76-30b2-487a-8472-e5d23995434d service nova] Creating event network-vif-plugged:3d57aa09-a07c-4b2f-a69b-70042434670c for instance 472c7a09-0157-404d-bd35-d765fd6baed6 on hv-cinder-83754 Jul 29 11:52:00.252047 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-25404915-0cb9-4eda-b619-012178352f65 req-762b1e76-30b2-487a-8472-e5d23995434d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039680 Jul 29 11:52:00.252745 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 325/664] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:52:00.274966 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-bf7f5d9d-5a05-4e5a-8ba4-d27ccbe6811c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:00.276426 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-bf7f5d9d-5a05-4e5a-8ba4-d27ccbe6811c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:00.298108 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bf7f5d9d-5a05-4e5a-8ba4-d27ccbe6811c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:00.299410 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bf7f5d9d-5a05-4e5a-8ba4-d27ccbe6811c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:00.300203 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bf7f5d9d-5a05-4e5a-8ba4-d27ccbe6811c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:00.300826 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bf7f5d9d-5a05-4e5a-8ba4-d27ccbe6811c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:00.515914 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bf7f5d9d-5a05-4e5a-8ba4-d27ccbe6811c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:00.525010 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bf7f5d9d-5a05-4e5a-8ba4-d27ccbe6811c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:00.526696 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bf7f5d9d-5a05-4e5a-8ba4-d27ccbe6811c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:00.527880 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-bf7f5d9d-5a05-4e5a-8ba4-d27ccbe6811c tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1740 microversion: 2.20 time: 0.261503 Jul 29 11:52:00.528440 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 340/665] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:00 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:00.921552 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5cf124e4-eade-4613-aeea-be1e3a08496b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:00.922572 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-5cf124e4-eade-4613-aeea-be1e3a08496b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:00.929619 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5cf124e4-eade-4613-aeea-be1e3a08496b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:00.930081 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5cf124e4-eade-4613-aeea-be1e3a08496b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:00.931162 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5cf124e4-eade-4613-aeea-be1e3a08496b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:00.931861 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5cf124e4-eade-4613-aeea-be1e3a08496b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:01.077011 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-5cf124e4-eade-4613-aeea-be1e3a08496b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:01.085621 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-5cf124e4-eade-4613-aeea-be1e3a08496b tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 200 len: 1368 microversion: 2.1 time: 0.168858 Jul 29 11:52:01.086202 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 326/666] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:00 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:52:01.550946 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-a3e602e6-16d4-43e0-a327-1c68044b9e44 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:01.552064 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-a3e602e6-16d4-43e0-a327-1c68044b9e44 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:01.554596 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=2 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:01.560778 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a3e602e6-16d4-43e0-a327-1c68044b9e44 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:01.561237 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a3e602e6-16d4-43e0-a327-1c68044b9e44 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:01.562248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a3e602e6-16d4-43e0-a327-1c68044b9e44 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:01.562874 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a3e602e6-16d4-43e0-a327-1c68044b9e44 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:01.918782 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a3e602e6-16d4-43e0-a327-1c68044b9e44 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:01.930532 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a3e602e6-16d4-43e0-a327-1c68044b9e44 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:01.932769 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a3e602e6-16d4-43e0-a327-1c68044b9e44 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:01.934321 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-a3e602e6-16d4-43e0-a327-1c68044b9e44 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1740 microversion: 2.20 time: 0.387192 Jul 29 11:52:01.935215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 341/667] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:01 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1740 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:02.107850 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-2735b07c-47f4-459c-acc2-7b2f9d6b0244 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:02.108496 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-2735b07c-47f4-459c-acc2-7b2f9d6b0244 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:02.111228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:02.112180 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=10 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:02.118157 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2735b07c-47f4-459c-acc2-7b2f9d6b0244 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:02.119118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2735b07c-47f4-459c-acc2-7b2f9d6b0244 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:02.120360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2735b07c-47f4-459c-acc2-7b2f9d6b0244 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:02.120978 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2735b07c-47f4-459c-acc2-7b2f9d6b0244 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:02.297119 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-2735b07c-47f4-459c-acc2-7b2f9d6b0244 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:02.311378 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-2735b07c-47f4-459c-acc2-7b2f9d6b0244 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 200 len: 1368 microversion: 2.1 time: 0.207738 Jul 29 11:52:02.312319 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 327/668] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:02 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:52:02.960254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-0e0475e8-c647-47d0-a4dc-fd874f9e08c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:02.962561 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-0e0475e8-c647-47d0-a4dc-fd874f9e08c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:02.972874 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0e0475e8-c647-47d0-a4dc-fd874f9e08c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:02.973620 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0e0475e8-c647-47d0-a4dc-fd874f9e08c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:02.974592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0e0475e8-c647-47d0-a4dc-fd874f9e08c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:02.975034 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0e0475e8-c647-47d0-a4dc-fd874f9e08c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:03.125450 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-0e0475e8-c647-47d0-a4dc-fd874f9e08c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:03.139684 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-0e0475e8-c647-47d0-a4dc-fd874f9e08c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:03.141624 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-0e0475e8-c647-47d0-a4dc-fd874f9e08c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:03.143078 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-0e0475e8-c647-47d0-a4dc-fd874f9e08c0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1740 microversion: 2.20 time: 0.187146 Jul 29 11:52:03.159761 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 342/669] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:02 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:03.336398 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9153e3a3-c418-40f9-9c22-cdfcb871f12f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:03.338031 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9153e3a3-c418-40f9-9c22-cdfcb871f12f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:03.340485 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:03.345929 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9153e3a3-c418-40f9-9c22-cdfcb871f12f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:03.346480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9153e3a3-c418-40f9-9c22-cdfcb871f12f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:03.347323 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9153e3a3-c418-40f9-9c22-cdfcb871f12f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:03.347857 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9153e3a3-c418-40f9-9c22-cdfcb871f12f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:03.513240 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9153e3a3-c418-40f9-9c22-cdfcb871f12f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:03.524170 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9153e3a3-c418-40f9-9c22-cdfcb871f12f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 200 len: 1558 microversion: 2.1 time: 0.191402 Jul 29 11:52:03.525816 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 328/670] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:03 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 1558 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:52:03.547179 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-859b19be-8548-4eea-8303-cdb179d8c380 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:03.548018 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-859b19be-8548-4eea-8303-cdb179d8c380 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:03.554465 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-859b19be-8548-4eea-8303-cdb179d8c380 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:03.554923 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-859b19be-8548-4eea-8303-cdb179d8c380 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:03.556253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-859b19be-8548-4eea-8303-cdb179d8c380 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:03.556893 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-859b19be-8548-4eea-8303-cdb179d8c380 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:03.651653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-859b19be-8548-4eea-8303-cdb179d8c380 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108372 Jul 29 11:52:03.652590 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 343/671] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Jul 29 11:52:03 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:52:04.170103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-fa94f329-5d0c-4832-a46f-96dd2e03ff86 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:04.170994 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-fa94f329-5d0c-4832-a46f-96dd2e03ff86 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:04.195460 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fa94f329-5d0c-4832-a46f-96dd2e03ff86 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:04.195917 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fa94f329-5d0c-4832-a46f-96dd2e03ff86 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:04.196769 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fa94f329-5d0c-4832-a46f-96dd2e03ff86 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:04.197210 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fa94f329-5d0c-4832-a46f-96dd2e03ff86 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:04.394136 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fa94f329-5d0c-4832-a46f-96dd2e03ff86 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:04.407557 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fa94f329-5d0c-4832-a46f-96dd2e03ff86 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:04.410133 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fa94f329-5d0c-4832-a46f-96dd2e03ff86 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:04.411706 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-fa94f329-5d0c-4832-a46f-96dd2e03ff86 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1740 microversion: 2.20 time: 0.245520 Jul 29 11:52:04.425458 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 329/672] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:04 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:05.278958 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-b8edb21d-3a45-45fe-b2ef-c05c5265c66a req-b133261e-6c44-4063-804f-ab5213caae79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "472c7a09-0157-404d-bd35-d765fd6baed6", "tag": "3d57aa09-a07c-4b2f-a69b-70042434670c"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:52:05.290442 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-b8edb21d-3a45-45fe-b2ef-c05c5265c66a req-b133261e-6c44-4063-804f-ab5213caae79 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:05.291180 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-b8edb21d-3a45-45fe-b2ef-c05c5265c66a req-b133261e-6c44-4063-804f-ab5213caae79 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:05.303672 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-b8edb21d-3a45-45fe-b2ef-c05c5265c66a req-b133261e-6c44-4063-804f-ab5213caae79 service nova] Creating event network-changed:3d57aa09-a07c-4b2f-a69b-70042434670c for instance 472c7a09-0157-404d-bd35-d765fd6baed6 on hv-cinder-83754 Jul 29 11:52:05.309784 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-b8edb21d-3a45-45fe-b2ef-c05c5265c66a req-b133261e-6c44-4063-804f-ab5213caae79 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176860 Jul 29 11:52:05.311021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 344/673] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:52:05.436794 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-51931a82-9029-4772-8645-9d918dc118d0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:05.437462 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-51931a82-9029-4772-8645-9d918dc118d0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:05.448522 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-51931a82-9029-4772-8645-9d918dc118d0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:05.448983 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-51931a82-9029-4772-8645-9d918dc118d0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:05.449798 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-51931a82-9029-4772-8645-9d918dc118d0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:05.453254 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-51931a82-9029-4772-8645-9d918dc118d0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:05.664553 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-51931a82-9029-4772-8645-9d918dc118d0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:05.676747 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-51931a82-9029-4772-8645-9d918dc118d0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:05.680941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-51931a82-9029-4772-8645-9d918dc118d0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:05.682957 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-51931a82-9029-4772-8645-9d918dc118d0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1740 microversion: 2.20 time: 0.250228 Jul 29 11:52:05.684141 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 330/674] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:05 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:06.708981 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c0a8705f-0b8b-4f28-8428-98f3b929c756 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:06.709706 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c0a8705f-0b8b-4f28-8428-98f3b929c756 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:06.716667 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c0a8705f-0b8b-4f28-8428-98f3b929c756 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:06.717124 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c0a8705f-0b8b-4f28-8428-98f3b929c756 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:06.717926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c0a8705f-0b8b-4f28-8428-98f3b929c756 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:06.718367 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c0a8705f-0b8b-4f28-8428-98f3b929c756 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:06.856686 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c0a8705f-0b8b-4f28-8428-98f3b929c756 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:06.864730 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c0a8705f-0b8b-4f28-8428-98f3b929c756 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:06.866271 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c0a8705f-0b8b-4f28-8428-98f3b929c756 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:06.867440 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c0a8705f-0b8b-4f28-8428-98f3b929c756 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1722 microversion: 2.20 time: 0.163282 Jul 29 11:52:06.868094 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 345/675] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:06 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:07.890803 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ebdd64fd-02b9-458d-af6c-5c22aa2dc850 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:07.891436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ebdd64fd-02b9-458d-af6c-5c22aa2dc850 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:07.897878 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ebdd64fd-02b9-458d-af6c-5c22aa2dc850 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:07.898321 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ebdd64fd-02b9-458d-af6c-5c22aa2dc850 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:07.899075 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ebdd64fd-02b9-458d-af6c-5c22aa2dc850 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:07.900036 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ebdd64fd-02b9-458d-af6c-5c22aa2dc850 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:08.035346 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ebdd64fd-02b9-458d-af6c-5c22aa2dc850 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:08.043801 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ebdd64fd-02b9-458d-af6c-5c22aa2dc850 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:08.045281 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ebdd64fd-02b9-458d-af6c-5c22aa2dc850 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:08.046456 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ebdd64fd-02b9-458d-af6c-5c22aa2dc850 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1722 microversion: 2.20 time: 0.159545 Jul 29 11:52:08.047007 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 331/676] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:07 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:09.068911 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3d0a17de-ef8c-4bc6-88af-0a715264158b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:09.069542 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3d0a17de-ef8c-4bc6-88af-0a715264158b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:09.076120 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3d0a17de-ef8c-4bc6-88af-0a715264158b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:09.076568 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3d0a17de-ef8c-4bc6-88af-0a715264158b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:09.077332 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3d0a17de-ef8c-4bc6-88af-0a715264158b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:09.077799 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3d0a17de-ef8c-4bc6-88af-0a715264158b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:09.206496 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3d0a17de-ef8c-4bc6-88af-0a715264158b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:09.214982 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3d0a17de-ef8c-4bc6-88af-0a715264158b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:09.216464 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3d0a17de-ef8c-4bc6-88af-0a715264158b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:09.217643 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3d0a17de-ef8c-4bc6-88af-0a715264158b tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1725 microversion: 2.20 time: 0.153518 Jul 29 11:52:09.218196 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 346/677] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:09 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:09.242240 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e968a6cc-99da-4d20-bde7-8fbf1a628462 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0623eba5-3643-4fe5-9805-81ec761fc6f5"}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:52:09.244703 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e968a6cc-99da-4d20-bde7-8fbf1a628462 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:09.251446 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e968a6cc-99da-4d20-bde7-8fbf1a628462 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:09.251903 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e968a6cc-99da-4d20-bde7-8fbf1a628462 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:09.252714 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e968a6cc-99da-4d20-bde7-8fbf1a628462 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:09.253160 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e968a6cc-99da-4d20-bde7-8fbf1a628462 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:09.546508 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e968a6cc-99da-4d20-bde7-8fbf1a628462 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "POST /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.309217 Jul 29 11:52:09.547111 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 332/678] 10.222.0.60 () {62 vars in 1364 bytes} [Fri Jul 29 11:52:09 2022] POST /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b/os-volume_attachments => generated 188 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 11:52:09.667508 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-79935e24-8016-4b2e-bf46-c2b0bc1befdb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:09.668038 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-79935e24-8016-4b2e-bf46-c2b0bc1befdb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:09.674054 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-79935e24-8016-4b2e-bf46-c2b0bc1befdb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:09.674506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-79935e24-8016-4b2e-bf46-c2b0bc1befdb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:09.675320 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-79935e24-8016-4b2e-bf46-c2b0bc1befdb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:09.675705 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-79935e24-8016-4b2e-bf46-c2b0bc1befdb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:09.762142 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:09.900322 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-79935e24-8016-4b2e-bf46-c2b0bc1befdb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "DELETE /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b/os-volume_attachments/0623eba5-3643-4fe5-9805-81ec761fc6f5" status: 202 len: 0 microversion: 2.20 time: 0.236822 Jul 29 11:52:09.900911 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 347/679] 10.222.0.60 () {60 vars in 1457 bytes} [Fri Jul 29 11:52:09 2022] DELETE /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b/os-volume_attachments/0623eba5-3643-4fe5-9805-81ec761fc6f5 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:52:09.961367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-63538a4a-5757-432b-b981-dcbeb36f58c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:52:09.962716 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-63538a4a-5757-432b-b981-dcbeb36f58c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:09.969519 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-63538a4a-5757-432b-b981-dcbeb36f58c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:09.969967 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-63538a4a-5757-432b-b981-dcbeb36f58c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:09.970726 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-63538a4a-5757-432b-b981-dcbeb36f58c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:09.971162 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-63538a4a-5757-432b-b981-dcbeb36f58c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:10.001104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-63538a4a-5757-432b-b981-dcbeb36f58c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129585) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 11:52:10.032568 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-07da8c25-090b-4050-a2ec-5f396fe00d5b tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:52:10.034954 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-07da8c25-090b-4050-a2ec-5f396fe00d5b tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:10.041574 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-07da8c25-090b-4050-a2ec-5f396fe00d5b tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:10.042251 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-07da8c25-090b-4050-a2ec-5f396fe00d5b tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:10.043223 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-07da8c25-090b-4050-a2ec-5f396fe00d5b tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:10.043672 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-07da8c25-090b-4050-a2ec-5f396fe00d5b tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:10.074107 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-63538a4a-5757-432b-b981-dcbeb36f58c8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "POST /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b/action" status: 202 len: 0 microversion: 2.20 time: 0.116289 Jul 29 11:52:10.075011 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 333/680] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Jul 29 11:52:09 2022] POST /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:52:10.133264 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-07da8c25-090b-4050-a2ec-5f396fe00d5b tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "POST /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/action" status: 202 len: 0 microversion: 2.1 time: 0.104595 Jul 29 11:52:10.135425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 348/681] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Jul 29 11:52:10 2022] POST /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:52:10.142396 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e09c42ab-6403-4ae5-b285-0d5e40a7ac45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:10.143186 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e09c42ab-6403-4ae5-b285-0d5e40a7ac45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:10.151114 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e09c42ab-6403-4ae5-b285-0d5e40a7ac45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:10.152266 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e09c42ab-6403-4ae5-b285-0d5e40a7ac45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:10.153224 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e09c42ab-6403-4ae5-b285-0d5e40a7ac45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:10.154008 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e09c42ab-6403-4ae5-b285-0d5e40a7ac45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:10.160933 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-982f7d43-59fe-4a4c-ad5a-ae4610b78511 req-2f7fef63-d8f1-4a88-bab1-4bbfafac5f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b28697-8f3b-4087-ae1b-836eb376d11b", "name": "network-vif-unplugged", "status": "completed", "tag": "d99e2239-1b7e-46f6-b919-e3f8a7ca8642"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:52:10.173722 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-982f7d43-59fe-4a4c-ad5a-ae4610b78511 req-2f7fef63-d8f1-4a88-bab1-4bbfafac5f0d service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:10.174172 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-982f7d43-59fe-4a4c-ad5a-ae4610b78511 req-2f7fef63-d8f1-4a88-bab1-4bbfafac5f0d service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:10.198850 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.compute.server_external_events [req-982f7d43-59fe-4a4c-ad5a-ae4610b78511 req-2f7fef63-d8f1-4a88-bab1-4bbfafac5f0d service nova] Unable to find a host for instance 21b28697-8f3b-4087-ae1b-836eb376d11b. Dropping event network-vif-unplugged {{(pid=129585) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 29 11:52:10.200031 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-982f7d43-59fe-4a4c-ad5a-ae4610b78511 req-2f7fef63-d8f1-4a88-bab1-4bbfafac5f0d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.123788 Jul 29 11:52:10.200797 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 334/682] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 125 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 29 11:52:10.206259 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c2f37edb-c3a9-4fde-9350-6889da41004e tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:10.207065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-c2f37edb-c3a9-4fde-9350-6889da41004e tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:10.214256 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c2f37edb-c3a9-4fde-9350-6889da41004e tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:10.214936 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c2f37edb-c3a9-4fde-9350-6889da41004e tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:10.215886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c2f37edb-c3a9-4fde-9350-6889da41004e tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:10.216482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c2f37edb-c3a9-4fde-9350-6889da41004e tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:10.235938 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:10.408865 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e09c42ab-6403-4ae5-b285-0d5e40a7ac45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:10.418551 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e09c42ab-6403-4ae5-b285-0d5e40a7ac45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:10.420330 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e09c42ab-6403-4ae5-b285-0d5e40a7ac45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:10.421773 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e09c42ab-6403-4ae5-b285-0d5e40a7ac45 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1673 microversion: 2.20 time: 0.285138 Jul 29 11:52:10.434095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 349/683] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:10 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1673 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:10.472871 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-c2f37edb-c3a9-4fde-9350-6889da41004e tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:10.482694 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-c2f37edb-c3a9-4fde-9350-6889da41004e tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1752 microversion: 2.1 time: 0.280653 Jul 29 11:52:10.483304 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 335/684] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:10 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1752 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:52:11.445299 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3e54dad6-bba3-4692-aeca-63aed85bcd1e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:11.446234 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3e54dad6-bba3-4692-aeca-63aed85bcd1e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:11.453682 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3e54dad6-bba3-4692-aeca-63aed85bcd1e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:11.454348 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3e54dad6-bba3-4692-aeca-63aed85bcd1e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:11.455339 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3e54dad6-bba3-4692-aeca-63aed85bcd1e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:11.456109 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3e54dad6-bba3-4692-aeca-63aed85bcd1e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:11.504119 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-0f78e3c6-208e-4c9c-8608-29aa5ef18d49 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:11.504815 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-0f78e3c6-208e-4c9c-8608-29aa5ef18d49 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:11.511642 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0f78e3c6-208e-4c9c-8608-29aa5ef18d49 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:11.512320 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0f78e3c6-208e-4c9c-8608-29aa5ef18d49 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:11.513102 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0f78e3c6-208e-4c9c-8608-29aa5ef18d49 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:11.513582 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0f78e3c6-208e-4c9c-8608-29aa5ef18d49 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:11.652478 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3e54dad6-bba3-4692-aeca-63aed85bcd1e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:11.661312 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3e54dad6-bba3-4692-aeca-63aed85bcd1e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:11.662964 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3e54dad6-bba3-4692-aeca-63aed85bcd1e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:11.664371 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3e54dad6-bba3-4692-aeca-63aed85bcd1e tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1731 microversion: 2.20 time: 0.223058 Jul 29 11:52:11.665303 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 350/685] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:11 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:11.693785 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-0f78e3c6-208e-4c9c-8608-29aa5ef18d49 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:11.702126 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-0f78e3c6-208e-4c9c-8608-29aa5ef18d49 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1757 microversion: 2.1 time: 0.201851 Jul 29 11:52:11.702698 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 336/686] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:11 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1757 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:52:12.690194 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-a42e2a52-895b-44cd-bd14-c82b4267dc15 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:12.690911 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-a42e2a52-895b-44cd-bd14-c82b4267dc15 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:12.697580 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a42e2a52-895b-44cd-bd14-c82b4267dc15 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:12.698118 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a42e2a52-895b-44cd-bd14-c82b4267dc15 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:12.698970 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a42e2a52-895b-44cd-bd14-c82b4267dc15 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:12.699480 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a42e2a52-895b-44cd-bd14-c82b4267dc15 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:12.724327 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-3d22b8c6-8427-4bc3-bc4e-1c23f9034e08 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:12.724945 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-3d22b8c6-8427-4bc3-bc4e-1c23f9034e08 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:12.732698 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3d22b8c6-8427-4bc3-bc4e-1c23f9034e08 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:12.733154 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3d22b8c6-8427-4bc3-bc4e-1c23f9034e08 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:12.733963 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3d22b8c6-8427-4bc3-bc4e-1c23f9034e08 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:12.734403 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3d22b8c6-8427-4bc3-bc4e-1c23f9034e08 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:12.913536 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a42e2a52-895b-44cd-bd14-c82b4267dc15 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:12.928093 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a42e2a52-895b-44cd-bd14-c82b4267dc15 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:12.929945 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-a42e2a52-895b-44cd-bd14-c82b4267dc15 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:12.931183 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-a42e2a52-895b-44cd-bd14-c82b4267dc15 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1731 microversion: 2.20 time: 0.246860 Jul 29 11:52:12.931749 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 351/687] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:12 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1731 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:12.959788 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-3d22b8c6-8427-4bc3-bc4e-1c23f9034e08 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:12.968710 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-3d22b8c6-8427-4bc3-bc4e-1c23f9034e08 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1757 microversion: 2.1 time: 0.248113 Jul 29 11:52:12.969282 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 337/688] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:12 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1757 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:52:13.954411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-da49204e-ffa0-436f-a46e-9040135b3acb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:13.955163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-da49204e-ffa0-436f-a46e-9040135b3acb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:13.962923 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-da49204e-ffa0-436f-a46e-9040135b3acb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:13.963381 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-da49204e-ffa0-436f-a46e-9040135b3acb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:13.964287 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-da49204e-ffa0-436f-a46e-9040135b3acb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:13.964739 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-da49204e-ffa0-436f-a46e-9040135b3acb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:13.992462 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-fdb8743c-46fc-4df8-8c9d-d47265065621 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:13.993639 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-fdb8743c-46fc-4df8-8c9d-d47265065621 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:14.002123 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fdb8743c-46fc-4df8-8c9d-d47265065621 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:14.002858 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fdb8743c-46fc-4df8-8c9d-d47265065621 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:14.003812 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fdb8743c-46fc-4df8-8c9d-d47265065621 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:14.004420 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fdb8743c-46fc-4df8-8c9d-d47265065621 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:14.180920 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-da49204e-ffa0-436f-a46e-9040135b3acb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:14.201783 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-da49204e-ffa0-436f-a46e-9040135b3acb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:14.203804 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-da49204e-ffa0-436f-a46e-9040135b3acb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:14.205438 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-da49204e-ffa0-436f-a46e-9040135b3acb tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1731 microversion: 2.20 time: 0.255165 Jul 29 11:52:14.223679 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 352/689] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:13 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1731 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:14.252399 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fdb8743c-46fc-4df8-8c9d-d47265065621 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:14.262242 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-fdb8743c-46fc-4df8-8c9d-d47265065621 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1757 microversion: 2.1 time: 0.273493 Jul 29 11:52:14.263248 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 338/690] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:13 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1757 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:52:15.232194 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6e29ea08-c8a1-4ea1-a047-dc24d35d67bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:15.233566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6e29ea08-c8a1-4ea1-a047-dc24d35d67bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:15.240595 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6e29ea08-c8a1-4ea1-a047-dc24d35d67bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:15.241183 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6e29ea08-c8a1-4ea1-a047-dc24d35d67bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:15.242205 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6e29ea08-c8a1-4ea1-a047-dc24d35d67bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:15.243337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6e29ea08-c8a1-4ea1-a047-dc24d35d67bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:15.284732 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9b5756a4-b857-408e-9153-ece39f18112a tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:15.295389 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9b5756a4-b857-408e-9153-ece39f18112a tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:15.303198 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9b5756a4-b857-408e-9153-ece39f18112a tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:15.303973 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9b5756a4-b857-408e-9153-ece39f18112a tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:15.304958 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9b5756a4-b857-408e-9153-ece39f18112a tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:15.306236 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9b5756a4-b857-408e-9153-ece39f18112a tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:15.540926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6e29ea08-c8a1-4ea1-a047-dc24d35d67bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:15.552601 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6e29ea08-c8a1-4ea1-a047-dc24d35d67bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:15.557582 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6e29ea08-c8a1-4ea1-a047-dc24d35d67bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:15.558816 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-6e29ea08-c8a1-4ea1-a047-dc24d35d67bc tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1731 microversion: 2.20 time: 0.331359 Jul 29 11:52:15.559506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 353/691] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:15 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1731 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:15.599509 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9b5756a4-b857-408e-9153-ece39f18112a tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:15.619673 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9b5756a4-b857-408e-9153-ece39f18112a tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1757 microversion: 2.1 time: 0.339147 Jul 29 11:52:15.620280 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 339/692] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:15 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1757 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:52:16.585542 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-74829fb4-cdc1-413a-9dee-4223cc52e6b0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:16.587151 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-74829fb4-cdc1-413a-9dee-4223cc52e6b0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:16.593651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-74829fb4-cdc1-413a-9dee-4223cc52e6b0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:16.594235 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-74829fb4-cdc1-413a-9dee-4223cc52e6b0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:16.595242 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-74829fb4-cdc1-413a-9dee-4223cc52e6b0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:16.595695 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-74829fb4-cdc1-413a-9dee-4223cc52e6b0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:16.645349 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a526a024-98fd-4360-ba87-3412b6cd494d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:16.646715 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a526a024-98fd-4360-ba87-3412b6cd494d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:16.655585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a526a024-98fd-4360-ba87-3412b6cd494d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:16.656401 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a526a024-98fd-4360-ba87-3412b6cd494d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:16.657359 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a526a024-98fd-4360-ba87-3412b6cd494d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:16.657984 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a526a024-98fd-4360-ba87-3412b6cd494d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:16.872029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-74829fb4-cdc1-413a-9dee-4223cc52e6b0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:16.900003 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-74829fb4-cdc1-413a-9dee-4223cc52e6b0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:16.902724 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-74829fb4-cdc1-413a-9dee-4223cc52e6b0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:16.904105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-74829fb4-cdc1-413a-9dee-4223cc52e6b0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1731 microversion: 2.20 time: 0.322571 Jul 29 11:52:16.905619 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 354/693] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:16 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1731 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:16.965624 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a526a024-98fd-4360-ba87-3412b6cd494d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:16.975841 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a526a024-98fd-4360-ba87-3412b6cd494d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1757 microversion: 2.1 time: 0.337723 Jul 29 11:52:16.985377 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 340/694] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:16 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1757 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:52:17.927748 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-aefe50da-8d08-4840-8a92-a16c1923f550 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:17.928364 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-aefe50da-8d08-4840-8a92-a16c1923f550 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:17.937328 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aefe50da-8d08-4840-8a92-a16c1923f550 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:17.938098 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aefe50da-8d08-4840-8a92-a16c1923f550 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:17.939015 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aefe50da-8d08-4840-8a92-a16c1923f550 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:17.939466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aefe50da-8d08-4840-8a92-a16c1923f550 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:18.002169 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-574b8831-4c5a-41bb-a55d-5112320a460e tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:18.002789 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-574b8831-4c5a-41bb-a55d-5112320a460e tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:18.009401 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-574b8831-4c5a-41bb-a55d-5112320a460e tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:18.010137 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-574b8831-4c5a-41bb-a55d-5112320a460e tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:18.010919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-574b8831-4c5a-41bb-a55d-5112320a460e tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:18.011356 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-574b8831-4c5a-41bb-a55d-5112320a460e tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:18.147525 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-aefe50da-8d08-4840-8a92-a16c1923f550 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:18.156032 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-aefe50da-8d08-4840-8a92-a16c1923f550 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:18.157568 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-aefe50da-8d08-4840-8a92-a16c1923f550 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:18.158976 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-aefe50da-8d08-4840-8a92-a16c1923f550 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1731 microversion: 2.20 time: 0.235189 Jul 29 11:52:18.159710 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 355/695] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:17 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:18.206017 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-574b8831-4c5a-41bb-a55d-5112320a460e tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:18.214615 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-574b8831-4c5a-41bb-a55d-5112320a460e tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1757 microversion: 2.1 time: 0.216265 Jul 29 11:52:18.215186 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 341/696] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:17 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1757 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:52:19.184469 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4c292ba7-c2b7-4fb8-a0db-939cdd17b001 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:19.185130 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-4c292ba7-c2b7-4fb8-a0db-939cdd17b001 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:19.193283 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4c292ba7-c2b7-4fb8-a0db-939cdd17b001 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:19.194184 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4c292ba7-c2b7-4fb8-a0db-939cdd17b001 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:19.195207 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4c292ba7-c2b7-4fb8-a0db-939cdd17b001 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:19.196632 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4c292ba7-c2b7-4fb8-a0db-939cdd17b001 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:19.236723 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-197e8ffe-5147-4a88-a80e-66cc67a61852 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:19.237357 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-197e8ffe-5147-4a88-a80e-66cc67a61852 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:19.247942 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-197e8ffe-5147-4a88-a80e-66cc67a61852 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:19.248303 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-197e8ffe-5147-4a88-a80e-66cc67a61852 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:19.249094 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-197e8ffe-5147-4a88-a80e-66cc67a61852 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:19.249584 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-197e8ffe-5147-4a88-a80e-66cc67a61852 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:19.428844 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4c292ba7-c2b7-4fb8-a0db-939cdd17b001 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:19.442518 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4c292ba7-c2b7-4fb8-a0db-939cdd17b001 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:19.444808 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4c292ba7-c2b7-4fb8-a0db-939cdd17b001 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:19.447102 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-4c292ba7-c2b7-4fb8-a0db-939cdd17b001 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1731 microversion: 2.20 time: 0.267403 Jul 29 11:52:19.447663 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 356/697] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:19 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1731 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:19.473500 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-197e8ffe-5147-4a88-a80e-66cc67a61852 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:19.482680 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-197e8ffe-5147-4a88-a80e-66cc67a61852 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1757 microversion: 2.1 time: 0.249780 Jul 29 11:52:19.483268 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 342/698] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:19 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1757 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:52:20.469688 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-64542591-8ddb-49be-9472-525e926bfa23 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:20.470332 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-64542591-8ddb-49be-9472-525e926bfa23 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:20.476709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-64542591-8ddb-49be-9472-525e926bfa23 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:20.477155 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-64542591-8ddb-49be-9472-525e926bfa23 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:20.477948 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-64542591-8ddb-49be-9472-525e926bfa23 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:20.478381 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-64542591-8ddb-49be-9472-525e926bfa23 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:20.505162 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-fb04442d-abbf-4990-a1a0-7ab2de66d880 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:20.509519 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-fb04442d-abbf-4990-a1a0-7ab2de66d880 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:20.514342 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fb04442d-abbf-4990-a1a0-7ab2de66d880 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:20.518138 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fb04442d-abbf-4990-a1a0-7ab2de66d880 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:20.520585 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fb04442d-abbf-4990-a1a0-7ab2de66d880 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:20.525944 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fb04442d-abbf-4990-a1a0-7ab2de66d880 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:20.738118 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-64542591-8ddb-49be-9472-525e926bfa23 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:20.759582 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-64542591-8ddb-49be-9472-525e926bfa23 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:20.761511 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-64542591-8ddb-49be-9472-525e926bfa23 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:20.762721 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-64542591-8ddb-49be-9472-525e926bfa23 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1731 microversion: 2.20 time: 0.296944 Jul 29 11:52:20.763494 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 357/699] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:20 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1731 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:20.806899 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fb04442d-abbf-4990-a1a0-7ab2de66d880 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:20.818256 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-fb04442d-abbf-4990-a1a0-7ab2de66d880 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1757 microversion: 2.1 time: 0.316843 Jul 29 11:52:20.819333 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 343/700] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:20 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1757 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:52:21.786473 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-2cb634aa-53aa-4f3e-b0e8-3ce7d08015ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:21.787086 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-2cb634aa-53aa-4f3e-b0e8-3ce7d08015ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:21.794258 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2cb634aa-53aa-4f3e-b0e8-3ce7d08015ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:21.794711 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2cb634aa-53aa-4f3e-b0e8-3ce7d08015ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:21.795478 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2cb634aa-53aa-4f3e-b0e8-3ce7d08015ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:21.795917 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2cb634aa-53aa-4f3e-b0e8-3ce7d08015ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:21.840167 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-441828c6-068c-4d4d-a05f-9da22cd1b86d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:21.840816 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-441828c6-068c-4d4d-a05f-9da22cd1b86d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:21.847512 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-441828c6-068c-4d4d-a05f-9da22cd1b86d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:21.847959 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-441828c6-068c-4d4d-a05f-9da22cd1b86d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:21.848925 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-441828c6-068c-4d4d-a05f-9da22cd1b86d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:21.849359 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-441828c6-068c-4d4d-a05f-9da22cd1b86d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:21.998664 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2cb634aa-53aa-4f3e-b0e8-3ce7d08015ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:22.011570 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2cb634aa-53aa-4f3e-b0e8-3ce7d08015ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:22.013100 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2cb634aa-53aa-4f3e-b0e8-3ce7d08015ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:22.015035 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-2cb634aa-53aa-4f3e-b0e8-3ce7d08015ba tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1731 microversion: 2.20 time: 0.232396 Jul 29 11:52:22.017467 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 358/701] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:21 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:22.040940 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-441828c6-068c-4d4d-a05f-9da22cd1b86d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:22.049840 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-441828c6-068c-4d4d-a05f-9da22cd1b86d tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1757 microversion: 2.1 time: 0.214144 Jul 29 11:52:22.050529 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 344/702] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:21 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1757 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:52:23.039386 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-30861a30-0c7c-48dd-8b4f-e561daa3d151 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:23.040004 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-30861a30-0c7c-48dd-8b4f-e561daa3d151 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:23.046462 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-30861a30-0c7c-48dd-8b4f-e561daa3d151 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:23.046923 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-30861a30-0c7c-48dd-8b4f-e561daa3d151 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:23.047705 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-30861a30-0c7c-48dd-8b4f-e561daa3d151 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:23.048142 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-30861a30-0c7c-48dd-8b4f-e561daa3d151 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:23.072710 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-eabaeb03-fa1d-4c43-9ca4-96c429664b48 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:23.073454 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-eabaeb03-fa1d-4c43-9ca4-96c429664b48 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:23.081059 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-eabaeb03-fa1d-4c43-9ca4-96c429664b48 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:23.081820 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-eabaeb03-fa1d-4c43-9ca4-96c429664b48 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:23.082765 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-eabaeb03-fa1d-4c43-9ca4-96c429664b48 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:23.083314 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-eabaeb03-fa1d-4c43-9ca4-96c429664b48 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:23.269664 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-30861a30-0c7c-48dd-8b4f-e561daa3d151 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:23.278557 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-30861a30-0c7c-48dd-8b4f-e561daa3d151 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:23.280061 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-30861a30-0c7c-48dd-8b4f-e561daa3d151 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:23.281383 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-30861a30-0c7c-48dd-8b4f-e561daa3d151 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1731 microversion: 2.20 time: 0.245840 Jul 29 11:52:23.282081 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 359/703] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:23 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1731 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:23.290071 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-eabaeb03-fa1d-4c43-9ca4-96c429664b48 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:23.298299 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-eabaeb03-fa1d-4c43-9ca4-96c429664b48 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1760 microversion: 2.1 time: 0.229985 Jul 29 11:52:23.298853 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 345/704] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:23 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1760 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:52:24.306004 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-bc47702d-d2fd-49c2-83cd-5c13c7ef56ec tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:24.306530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-bc47702d-d2fd-49c2-83cd-5c13c7ef56ec tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:24.312995 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bc47702d-d2fd-49c2-83cd-5c13c7ef56ec tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:24.313492 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bc47702d-d2fd-49c2-83cd-5c13c7ef56ec tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:24.314244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bc47702d-d2fd-49c2-83cd-5c13c7ef56ec tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:24.314681 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bc47702d-d2fd-49c2-83cd-5c13c7ef56ec tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:24.449814 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bc47702d-d2fd-49c2-83cd-5c13c7ef56ec tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:24.458557 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bc47702d-d2fd-49c2-83cd-5c13c7ef56ec tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:24.460165 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bc47702d-d2fd-49c2-83cd-5c13c7ef56ec tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:24.461804 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-bc47702d-d2fd-49c2-83cd-5c13c7ef56ec tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1731 microversion: 2.20 time: 0.160343 Jul 29 11:52:24.462391 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 360/705] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:24 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:25.485603 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a4367f90-ddd6-4210-8461-cee72e62bc4d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:25.486329 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a4367f90-ddd6-4210-8461-cee72e62bc4d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:25.494745 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a4367f90-ddd6-4210-8461-cee72e62bc4d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:25.495323 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a4367f90-ddd6-4210-8461-cee72e62bc4d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:25.496518 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a4367f90-ddd6-4210-8461-cee72e62bc4d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:25.497116 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a4367f90-ddd6-4210-8461-cee72e62bc4d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:25.639727 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a4367f90-ddd6-4210-8461-cee72e62bc4d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:25.650499 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a4367f90-ddd6-4210-8461-cee72e62bc4d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:25.652017 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a4367f90-ddd6-4210-8461-cee72e62bc4d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:25.653207 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a4367f90-ddd6-4210-8461-cee72e62bc4d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1731 microversion: 2.20 time: 0.172117 Jul 29 11:52:25.653985 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 346/706] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:25 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:26.137117 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-64c980d0-ef96-4a76-9d60-ea66bed81b98 req-7c9629a9-d3e2-4a34-88b3-5ac681f32bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b28697-8f3b-4087-ae1b-836eb376d11b", "name": "network-vif-plugged", "status": "completed", "tag": "d99e2239-1b7e-46f6-b919-e3f8a7ca8642"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:52:26.147111 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-64c980d0-ef96-4a76-9d60-ea66bed81b98 req-7c9629a9-d3e2-4a34-88b3-5ac681f32bfd service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:26.147583 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-64c980d0-ef96-4a76-9d60-ea66bed81b98 req-7c9629a9-d3e2-4a34-88b3-5ac681f32bfd service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:26.160927 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-64c980d0-ef96-4a76-9d60-ea66bed81b98 req-7c9629a9-d3e2-4a34-88b3-5ac681f32bfd service nova] Creating event network-vif-plugged:d99e2239-1b7e-46f6-b919-e3f8a7ca8642 for instance 21b28697-8f3b-4087-ae1b-836eb376d11b on hv-cinder-83754 Jul 29 11:52:26.165808 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-64c980d0-ef96-4a76-9d60-ea66bed81b98 req-7c9629a9-d3e2-4a34-88b3-5ac681f32bfd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033302 Jul 29 11:52:26.166392 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 361/707] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:52:26.676080 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-010a7da6-4c49-41b1-ad66-116d143414bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:26.676733 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-010a7da6-4c49-41b1-ad66-116d143414bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:26.683999 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-010a7da6-4c49-41b1-ad66-116d143414bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:26.684432 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-010a7da6-4c49-41b1-ad66-116d143414bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:26.685222 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-010a7da6-4c49-41b1-ad66-116d143414bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:26.685684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-010a7da6-4c49-41b1-ad66-116d143414bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:26.825388 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-010a7da6-4c49-41b1-ad66-116d143414bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:26.840949 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-010a7da6-4c49-41b1-ad66-116d143414bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:26.842519 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-010a7da6-4c49-41b1-ad66-116d143414bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:26.843798 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-010a7da6-4c49-41b1-ad66-116d143414bd tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1731 microversion: 2.20 time: 0.171637 Jul 29 11:52:26.844362 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 347/708] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:26 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:27.868825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6ca2b0c5-ffc8-401b-8aa8-3e39b7c53743 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:27.869654 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6ca2b0c5-ffc8-401b-8aa8-3e39b7c53743 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:27.876431 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6ca2b0c5-ffc8-401b-8aa8-3e39b7c53743 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:27.876888 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6ca2b0c5-ffc8-401b-8aa8-3e39b7c53743 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:27.877694 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6ca2b0c5-ffc8-401b-8aa8-3e39b7c53743 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:27.878136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6ca2b0c5-ffc8-401b-8aa8-3e39b7c53743 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:27.893905 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:28.030491 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6ca2b0c5-ffc8-401b-8aa8-3e39b7c53743 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:28.039622 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6ca2b0c5-ffc8-401b-8aa8-3e39b7c53743 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:28.041348 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6ca2b0c5-ffc8-401b-8aa8-3e39b7c53743 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:28.042564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-6ca2b0c5-ffc8-401b-8aa8-3e39b7c53743 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1731 microversion: 2.20 time: 0.178612 Jul 29 11:52:28.043488 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 362/709] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:27 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:29.065262 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9b5fe59f-51c8-464e-9512-99fa9dbc7a47 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:29.065921 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9b5fe59f-51c8-464e-9512-99fa9dbc7a47 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:29.073153 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9b5fe59f-51c8-464e-9512-99fa9dbc7a47 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:29.073636 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9b5fe59f-51c8-464e-9512-99fa9dbc7a47 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:29.074423 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9b5fe59f-51c8-464e-9512-99fa9dbc7a47 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:29.074842 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9b5fe59f-51c8-464e-9512-99fa9dbc7a47 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:29.207172 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9b5fe59f-51c8-464e-9512-99fa9dbc7a47 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:29.215124 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9b5fe59f-51c8-464e-9512-99fa9dbc7a47 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:29.216636 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9b5fe59f-51c8-464e-9512-99fa9dbc7a47 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:29.217837 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9b5fe59f-51c8-464e-9512-99fa9dbc7a47 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1718 microversion: 2.20 time: 0.156475 Jul 29 11:52:29.218400 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 348/710] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:52:29 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 11:52:42.974333 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6f6980f9-0ef6-4000-b6a0-6fee76f7f898 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:42.974878 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6f6980f9-0ef6-4000-b6a0-6fee76f7f898 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:42.977026 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=49 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:42.977697 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=3 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:42.983282 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6f6980f9-0ef6-4000-b6a0-6fee76f7f898 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:42.983742 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6f6980f9-0ef6-4000-b6a0-6fee76f7f898 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:42.984514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6f6980f9-0ef6-4000-b6a0-6fee76f7f898 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:42.984957 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6f6980f9-0ef6-4000-b6a0-6fee76f7f898 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:43.008554 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-6f6980f9-0ef6-4000-b6a0-6fee76f7f898 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6/ips" status: 200 len: 149 microversion: 2.1 time: 0.038207 Jul 29 11:52:43.009119 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 363/711] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Jul 29 11:52:42 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:52:44.333635 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-14320c93-64c9-455c-ba27-5934956d14b8 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4489a1af-915c-4ec2-b5b1-a98f6b778023"}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:52:44.336852 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-14320c93-64c9-455c-ba27-5934956d14b8 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:44.339089 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:44.339756 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=80 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:52:44.345701 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-14320c93-64c9-455c-ba27-5934956d14b8 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:44.346152 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-14320c93-64c9-455c-ba27-5934956d14b8 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:44.346920 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-14320c93-64c9-455c-ba27-5934956d14b8 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:44.347358 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-14320c93-64c9-455c-ba27-5934956d14b8 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:44.585345 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-14320c93-64c9-455c-ba27-5934956d14b8 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "POST /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255500 Jul 29 11:52:44.586254 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 349/712] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Jul 29 11:52:44 2022] POST /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:52:51.149819 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-8f4aa905-b052-4fa2-90f0-aabcb0376b54 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:51.150347 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-8f4aa905-b052-4fa2-90f0-aabcb0376b54 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:51.156851 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8f4aa905-b052-4fa2-90f0-aabcb0376b54 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:51.157438 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8f4aa905-b052-4fa2-90f0-aabcb0376b54 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:51.158217 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8f4aa905-b052-4fa2-90f0-aabcb0376b54 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:51.158659 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8f4aa905-b052-4fa2-90f0-aabcb0376b54 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:51.244244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-8f4aa905-b052-4fa2-90f0-aabcb0376b54 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lazy-loading 'services' on Instance uuid 472c7a09-0157-404d-bd35-d765fd6baed6 {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:52:51.315122 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-8f4aa905-b052-4fa2-90f0-aabcb0376b54 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "DELETE /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6/os-volume_attachments/4489a1af-915c-4ec2-b5b1-a98f6b778023" status: 202 len: 0 microversion: 2.1 time: 0.169302 Jul 29 11:52:51.315711 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 364/713] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Jul 29 11:52:51 2022] DELETE /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6/os-volume_attachments/4489a1af-915c-4ec2-b5b1-a98f6b778023 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 11:52:51.325062 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-91ba3e5e-7a6f-45cd-9701-843a90b6edbe tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:51.327629 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-91ba3e5e-7a6f-45cd-9701-843a90b6edbe tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:51.334366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-91ba3e5e-7a6f-45cd-9701-843a90b6edbe tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:51.335417 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-91ba3e5e-7a6f-45cd-9701-843a90b6edbe tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:51.336234 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-91ba3e5e-7a6f-45cd-9701-843a90b6edbe tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:51.336676 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-91ba3e5e-7a6f-45cd-9701-843a90b6edbe tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:51.369941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-91ba3e5e-7a6f-45cd-9701-843a90b6edbe tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049163 Jul 29 11:52:51.370571 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 350/714] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:52:51 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:52:52.382918 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d2e3ba2c-f61e-4544-ad3a-fa79f5b294f7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:52.385525 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d2e3ba2c-f61e-4544-ad3a-fa79f5b294f7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:52.392248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d2e3ba2c-f61e-4544-ad3a-fa79f5b294f7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:52.392700 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d2e3ba2c-f61e-4544-ad3a-fa79f5b294f7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:52.393483 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d2e3ba2c-f61e-4544-ad3a-fa79f5b294f7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:52.393927 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d2e3ba2c-f61e-4544-ad3a-fa79f5b294f7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:52.422990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d2e3ba2c-f61e-4544-ad3a-fa79f5b294f7 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044927 Jul 29 11:52:52.423546 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 365/715] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:52:52 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 29 11:52:52.484320 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e02204df-7212-4851-ac1c-31548b785bdb tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:52.484841 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e02204df-7212-4851-ac1c-31548b785bdb tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:52.491323 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e02204df-7212-4851-ac1c-31548b785bdb tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:52.491779 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e02204df-7212-4851-ac1c-31548b785bdb tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:52.492617 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e02204df-7212-4851-ac1c-31548b785bdb tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:52.493046 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e02204df-7212-4851-ac1c-31548b785bdb tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:52.519095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e02204df-7212-4851-ac1c-31548b785bdb tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Going to try to terminate instance {{(pid=129585) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:52:52.595724 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e02204df-7212-4851-ac1c-31548b785bdb tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "DELETE /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 204 len: 0 microversion: 2.1 time: 0.114927 Jul 29 11:52:52.596315 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 351/716] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:52:52 2022] DELETE /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:52:52.605574 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d3b1350e-3770-4594-be23-d1cd34d9d662 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:52.606184 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d3b1350e-3770-4594-be23-d1cd34d9d662 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:52.612272 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d3b1350e-3770-4594-be23-d1cd34d9d662 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:52.612723 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d3b1350e-3770-4594-be23-d1cd34d9d662 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:52.613532 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d3b1350e-3770-4594-be23-d1cd34d9d662 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:52.613972 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d3b1350e-3770-4594-be23-d1cd34d9d662 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:52.743507 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d3b1350e-3770-4594-be23-d1cd34d9d662 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:52.750955 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d3b1350e-3770-4594-be23-d1cd34d9d662 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 200 len: 1682 microversion: 2.1 time: 0.149280 Jul 29 11:52:52.751519 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 366/717] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:52 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:52:53.773302 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-11209378-8e7d-4d3d-9b53-909ad8ff57b4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:53.774047 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-11209378-8e7d-4d3d-9b53-909ad8ff57b4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:53.780499 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-11209378-8e7d-4d3d-9b53-909ad8ff57b4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:53.780946 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-11209378-8e7d-4d3d-9b53-909ad8ff57b4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:53.781737 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-11209378-8e7d-4d3d-9b53-909ad8ff57b4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:53.782172 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-11209378-8e7d-4d3d-9b53-909ad8ff57b4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:53.914915 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-11209378-8e7d-4d3d-9b53-909ad8ff57b4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:53.922332 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-11209378-8e7d-4d3d-9b53-909ad8ff57b4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 200 len: 1682 microversion: 2.1 time: 0.153817 Jul 29 11:52:53.922890 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 352/718] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:53 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:52:54.943855 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3c4196c8-4ca2-4531-b95a-290fa4d50009 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:54.945017 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3c4196c8-4ca2-4531-b95a-290fa4d50009 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:54.951843 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3c4196c8-4ca2-4531-b95a-290fa4d50009 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:54.952297 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3c4196c8-4ca2-4531-b95a-290fa4d50009 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:54.953068 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3c4196c8-4ca2-4531-b95a-290fa4d50009 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:54.953528 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3c4196c8-4ca2-4531-b95a-290fa4d50009 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:55.016511 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3c4196c8-4ca2-4531-b95a-290fa4d50009 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343996462b462d86fb89b876f4e127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4b9969357142bc8724804eb47e0c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:52:55.024253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3c4196c8-4ca2-4531-b95a-290fa4d50009 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 200 len: 1614 microversion: 2.1 time: 0.084574 Jul 29 11:52:55.024831 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 367/719] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:54 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 1614 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:52:55.192408 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-f189a328-36f6-47c9-811d-36cd2071817b req-eb55cab8-aa0f-47bf-8139-bec0b10e4460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "472c7a09-0157-404d-bd35-d765fd6baed6", "name": "network-vif-deleted", "tag": "3d57aa09-a07c-4b2f-a69b-70042434670c"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:52:55.204735 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-f189a328-36f6-47c9-811d-36cd2071817b req-eb55cab8-aa0f-47bf-8139-bec0b10e4460 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:55.205322 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-f189a328-36f6-47c9-811d-36cd2071817b req-eb55cab8-aa0f-47bf-8139-bec0b10e4460 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:55.217855 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-f189a328-36f6-47c9-811d-36cd2071817b req-eb55cab8-aa0f-47bf-8139-bec0b10e4460 service nova] Creating event network-vif-deleted:3d57aa09-a07c-4b2f-a69b-70042434670c for instance 472c7a09-0157-404d-bd35-d765fd6baed6 on hv-cinder-83754 Jul 29 11:52:55.223006 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-f189a328-36f6-47c9-811d-36cd2071817b req-eb55cab8-aa0f-47bf-8139-bec0b10e4460 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034284 Jul 29 11:52:55.224064 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 353/720] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:52:56.048379 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-450d4eec-bcbc-4c64-94fc-7c52ff87570f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:56.049003 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-450d4eec-bcbc-4c64-94fc-7c52ff87570f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:56.056583 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-450d4eec-bcbc-4c64-94fc-7c52ff87570f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:56.057041 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-450d4eec-bcbc-4c64-94fc-7c52ff87570f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:56.057843 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-450d4eec-bcbc-4c64-94fc-7c52ff87570f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:56.058284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-450d4eec-bcbc-4c64-94fc-7c52ff87570f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:56.071785 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-450d4eec-bcbc-4c64-94fc-7c52ff87570f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] HTTP exception thrown: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-450d4eec-bcbc-4c64-94fc-7c52ff87570f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Request method failure captured: Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 HTTP/1.1 Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48icVbGQpo_IdH8_u62UoQcPfoUo3xwllOW7fjakcJXUphVjQAJzVqE7fI-fsqP3g4NqZjz8YFLyejjO-VLv92lJBWa3RdJ2AtZ841GWsHIbm-PB-ZcSKgDGNNp_FYxiDV5ReNSeL7mFuVa5RErCcpxqZKkcIeuKO_mbw7bKo_jOIw8 Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:52:56.073405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:52:56.074772 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4b9969357142bc8724804eb47e0c48", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:52:56.074772 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:56.074772 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:52:56.074772 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:56.074772 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:52:56.074772 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:52:56.074772 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:52:56.074772 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 1a343996462b462d86fb89b876f4e127 Jul 29 11:52:56.074772 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:52:56.074772 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:52:56.074772 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. Jul 29 11:52:56.074772 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '472c7a09-0157-404d-bd35-d765fd6baed6'} Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:52:56.075560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. Jul 29 11:52:56.076973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:56.078325 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-450d4eec-bcbc-4c64-94fc-7c52ff87570f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Returning 404 to user: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:52:56.078325 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-450d4eec-bcbc-4c64-94fc-7c52ff87570f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 404 len: 111 microversion: 2.1 time: 0.031408 Jul 29 11:52:56.078325 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 368/721] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:56 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:52:56.084443 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-34945668-0260-493f-b075-f8d5f186eaf9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '.version_select at 0x7f68f9f018b0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:56.104940 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-34945668-0260-493f-b075-f8d5f186eaf9 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1408142609" status: 202 len: 0 microversion: 2.1 time: 0.024633 Jul 29 11:52:56.105676 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 354/722] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Jul 29 11:52:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1408142609 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:52:57.869563 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9de3ce1a-f203-4220-a2d6-37956075e902 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:57.870083 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-9de3ce1a-f203-4220-a2d6-37956075e902 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:57.876427 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9de3ce1a-f203-4220-a2d6-37956075e902 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:57.876877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9de3ce1a-f203-4220-a2d6-37956075e902 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:57.877660 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9de3ce1a-f203-4220-a2d6-37956075e902 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:57.878093 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9de3ce1a-f203-4220-a2d6-37956075e902 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:57.891662 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-9de3ce1a-f203-4220-a2d6-37956075e902 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] HTTP exception thrown: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9de3ce1a-f203-4220-a2d6-37956075e902 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Request method failure captured: Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: DELETE /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 HTTP/1.1 Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48icVbGQpo_IdH8_u62UoQcPfoUo3xwllOW7fjakcJXUphVjQAJzVqE7fI-fsqP3g4NqZjz8YFLyejjO-VLv92lJBWa3RdJ2AtZ841GWsHIbm-PB-ZcSKgDGNNp_FYxiDV5ReNSeL7mFuVa5RErCcpxqZKkcIeuKO_mbw7bKo_jOIw8 Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:52:57.893105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:52:57.894651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4b9969357142bc8724804eb47e0c48", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:52:57.894651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:57.894651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:52:57.894651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:57.894651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:52:57.894651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:52:57.894651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:52:57.894651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 1a343996462b462d86fb89b876f4e127 Jul 29 11:52:57.894651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:52:57.894651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:52:57.894651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. Jul 29 11:52:57.894651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '472c7a09-0157-404d-bd35-d765fd6baed6'} Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:52:57.895453 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. Jul 29 11:52:57.896592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:57.898225 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9de3ce1a-f203-4220-a2d6-37956075e902 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Returning 404 to user: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:52:57.898225 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-9de3ce1a-f203-4220-a2d6-37956075e902 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "DELETE /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 404 len: 111 microversion: 2.1 time: 0.029473 Jul 29 11:52:57.898225 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 369/723] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:52:57 2022] DELETE /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:52:57.903003 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-2b75982c-2f7e-4557-a790-e4f5b351ef35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:57.903748 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-2b75982c-2f7e-4557-a790-e4f5b351ef35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 472c7a09-0157-404d-bd35-d765fd6baed6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:57.910889 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2b75982c-2f7e-4557-a790-e4f5b351ef35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:57.911348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2b75982c-2f7e-4557-a790-e4f5b351ef35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:57.912119 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2b75982c-2f7e-4557-a790-e4f5b351ef35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:57.913149 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2b75982c-2f7e-4557-a790-e4f5b351ef35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:57.926390 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-2b75982c-2f7e-4557-a790-e4f5b351ef35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] HTTP exception thrown: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-2b75982c-2f7e-4557-a790-e4f5b351ef35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Request method failure captured: Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 HTTP/1.1 Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48icVbGQpo_IdH8_u62UoQcPfoUo3xwllOW7fjakcJXUphVjQAJzVqE7fI-fsqP3g4NqZjz8YFLyejjO-VLv92lJBWa3RdJ2AtZ841GWsHIbm-PB-ZcSKgDGNNp_FYxiDV5ReNSeL7mFuVa5RErCcpxqZKkcIeuKO_mbw7bKo_jOIw8 Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:52:57.927996 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:52:57.930216 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4b9969357142bc8724804eb47e0c48", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:52:57.930216 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:57.930216 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:52:57.930216 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:57.930216 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:52:57.930216 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:52:57.930216 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:52:57.930216 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 1a343996462b462d86fb89b876f4e127 Jul 29 11:52:57.930216 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:52:57.930216 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:52:57.930216 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. Jul 29 11:52:57.930216 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': '472c7a09-0157-404d-bd35-d765fd6baed6'} Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:52:57.931074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. Jul 29 11:52:57.932397 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:52:57.933638 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-2b75982c-2f7e-4557-a790-e4f5b351ef35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Returning 404 to user: Instance 472c7a09-0157-404d-bd35-d765fd6baed6 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:52:57.933638 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-2b75982c-2f7e-4557-a790-e4f5b351ef35 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6" status: 404 len: 111 microversion: 2.1 time: 0.031347 Jul 29 11:52:57.933638 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 355/724] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:57 2022] GET /compute/v2.1/servers/472c7a09-0157-404d-bd35-d765fd6baed6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:52:59.070836 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4b256f3e-bccd-401e-af70-d2578ff55eb4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:59.071340 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-4b256f3e-bccd-401e-af70-d2578ff55eb4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:59.077825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4b256f3e-bccd-401e-af70-d2578ff55eb4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:59.078287 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4b256f3e-bccd-401e-af70-d2578ff55eb4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:59.079059 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4b256f3e-bccd-401e-af70-d2578ff55eb4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:59.079504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4b256f3e-bccd-401e-af70-d2578ff55eb4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:59.092937 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-4b256f3e-bccd-401e-af70-d2578ff55eb4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] HTTP exception thrown: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4b256f3e-bccd-401e-af70-d2578ff55eb4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Request method failure captured: Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: DELETE /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 HTTP/1.1 Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48icVbGQpo_IdH8_u62UoQcPfoUo3xwllOW7fjakcJXUphVjQAJzVqE7fI-fsqP3g4NqZjz8YFLyejjO-VLv92lJBWa3RdJ2AtZ841GWsHIbm-PB-ZcSKgDGNNp_FYxiDV5ReNSeL7mFuVa5RErCcpxqZKkcIeuKO_mbw7bKo_jOIw8 Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:52:59.094505 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:52:59.095879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4b9969357142bc8724804eb47e0c48", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:52:59.095879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:59.095879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:52:59.095879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:59.095879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:52:59.095879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:52:59.095879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:52:59.095879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 1a343996462b462d86fb89b876f4e127 Jul 29 11:52:59.095879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:52:59.095879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:52:59.095879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. Jul 29 11:52:59.095879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '439cbe53-546a-4902-a4e7-c25b4a7b84d0'} Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:52:59.099306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. Jul 29 11:52:59.101163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.102349 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4b256f3e-bccd-401e-af70-d2578ff55eb4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Returning 404 to user: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:52:59.102349 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-4b256f3e-bccd-401e-af70-d2578ff55eb4 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "DELETE /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 404 len: 111 microversion: 2.1 time: 0.029590 Jul 29 11:52:59.102349 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 370/725] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:52:59 2022] DELETE /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:52:59.104790 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-77e4e2dd-bde3-4921-854a-9940a1e369d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:59.105408 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-77e4e2dd-bde3-4921-854a-9940a1e369d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 439cbe53-546a-4902-a4e7-c25b4a7b84d0] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:59.111880 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-77e4e2dd-bde3-4921-854a-9940a1e369d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:59.112359 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-77e4e2dd-bde3-4921-854a-9940a1e369d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:59.113117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-77e4e2dd-bde3-4921-854a-9940a1e369d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:59.113581 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-77e4e2dd-bde3-4921-854a-9940a1e369d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:59.127451 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-77e4e2dd-bde3-4921-854a-9940a1e369d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] HTTP exception thrown: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-77e4e2dd-bde3-4921-854a-9940a1e369d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Request method failure captured: Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 HTTP/1.1 Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48icVbGQpo_IdH8_u62UoQcPfoUo3xwllOW7fjakcJXUphVjQAJzVqE7fI-fsqP3g4NqZjz8YFLyejjO-VLv92lJBWa3RdJ2AtZ841GWsHIbm-PB-ZcSKgDGNNp_FYxiDV5ReNSeL7mFuVa5RErCcpxqZKkcIeuKO_mbw7bKo_jOIw8 Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:52:59.128956 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:52:59.130353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4b9969357142bc8724804eb47e0c48", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:52:59.130353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:59.130353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:52:59.130353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:59.130353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:52:59.130353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:52:59.130353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:52:59.130353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 1a343996462b462d86fb89b876f4e127 Jul 29 11:52:59.130353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:52:59.130353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:52:59.130353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. Jul 29 11:52:59.130353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': '439cbe53-546a-4902-a4e7-c25b4a7b84d0'} Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:52:59.131103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. Jul 29 11:52:59.133128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.134301 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-77e4e2dd-bde3-4921-854a-9940a1e369d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Returning 404 to user: Instance 439cbe53-546a-4902-a4e7-c25b4a7b84d0 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:52:59.134301 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-77e4e2dd-bde3-4921-854a-9940a1e369d3 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0" status: 404 len: 111 microversion: 2.1 time: 0.029373 Jul 29 11:52:59.134301 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 356/726] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:59 2022] GET /compute/v2.1/servers/439cbe53-546a-4902-a4e7-c25b4a7b84d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:52:59.139870 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d75d45cf-6a51-4d37-968f-d43c45fc5c04 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:59.140378 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d75d45cf-6a51-4d37-968f-d43c45fc5c04 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:59.146448 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d75d45cf-6a51-4d37-968f-d43c45fc5c04 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:59.147028 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d75d45cf-6a51-4d37-968f-d43c45fc5c04 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:59.148394 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d75d45cf-6a51-4d37-968f-d43c45fc5c04 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:59.148831 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d75d45cf-6a51-4d37-968f-d43c45fc5c04 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:59.162196 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-d75d45cf-6a51-4d37-968f-d43c45fc5c04 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] HTTP exception thrown: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d75d45cf-6a51-4d37-968f-d43c45fc5c04 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Request method failure captured: Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: DELETE /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 HTTP/1.1 Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48icVbGQpo_IdH8_u62UoQcPfoUo3xwllOW7fjakcJXUphVjQAJzVqE7fI-fsqP3g4NqZjz8YFLyejjO-VLv92lJBWa3RdJ2AtZ841GWsHIbm-PB-ZcSKgDGNNp_FYxiDV5ReNSeL7mFuVa5RErCcpxqZKkcIeuKO_mbw7bKo_jOIw8 Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:52:59.163909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:52:59.165497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4b9969357142bc8724804eb47e0c48", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:52:59.165497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:59.165497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:52:59.165497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:59.165497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:52:59.165497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:52:59.165497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:52:59.165497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 1a343996462b462d86fb89b876f4e127 Jul 29 11:52:59.165497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:52:59.165497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:52:59.165497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. Jul 29 11:52:59.165497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '9fca404e-1bae-45f1-b4c7-0f1363d90a44'} Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:52:59.166405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. Jul 29 11:52:59.167771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.169147 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d75d45cf-6a51-4d37-968f-d43c45fc5c04 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Returning 404 to user: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:52:59.169147 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d75d45cf-6a51-4d37-968f-d43c45fc5c04 tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 404 len: 111 microversion: 2.1 time: 0.029297 Jul 29 11:52:59.169147 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 371/727] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:52:59 2022] DELETE /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:52:59.173784 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-f10bfc8e-c472-4597-828d-9798de837d5f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:52:59.174402 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-f10bfc8e-c472-4597-828d-9798de837d5f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 9fca404e-1bae-45f1-b4c7-0f1363d90a44] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:52:59.180757 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f10bfc8e-c472-4597-828d-9798de837d5f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:59.181207 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f10bfc8e-c472-4597-828d-9798de837d5f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:59.182011 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f10bfc8e-c472-4597-828d-9798de837d5f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:52:59.182452 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f10bfc8e-c472-4597-828d-9798de837d5f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:52:59.196842 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-f10bfc8e-c472-4597-828d-9798de837d5f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] HTTP exception thrown: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-f10bfc8e-c472-4597-828d-9798de837d5f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Request method failure captured: Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 HTTP/1.1 Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48icVbGQpo_IdH8_u62UoQcPfoUo3xwllOW7fjakcJXUphVjQAJzVqE7fI-fsqP3g4NqZjz8YFLyejjO-VLv92lJBWa3RdJ2AtZ841GWsHIbm-PB-ZcSKgDGNNp_FYxiDV5ReNSeL7mFuVa5RErCcpxqZKkcIeuKO_mbw7bKo_jOIw8 Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:52:59.198436 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:52:59.199943 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4b9969357142bc8724804eb47e0c48", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:52:59.199943 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:59.199943 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:52:59.199943 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:52:59.199943 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:52:59.199943 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:52:59.199943 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:52:59.199943 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 1a343996462b462d86fb89b876f4e127 Jul 29 11:52:59.199943 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:52:59.199943 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:52:59.199943 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. Jul 29 11:52:59.199943 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': '9fca404e-1bae-45f1-b4c7-0f1363d90a44'} Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:52:59.200923 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. Jul 29 11:52:59.202382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:52:59.203968 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-f10bfc8e-c472-4597-828d-9798de837d5f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Returning 404 to user: Instance 9fca404e-1bae-45f1-b4c7-0f1363d90a44 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:52:59.203968 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-f10bfc8e-c472-4597-828d-9798de837d5f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44" status: 404 len: 111 microversion: 2.1 time: 0.029843 Jul 29 11:52:59.203968 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 357/728] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:52:59 2022] GET /compute/v2.1/servers/9fca404e-1bae-45f1-b4c7-0f1363d90a44 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:53:00.336946 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d9578dc5-bd32-4b78-8e9a-7a941361653f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:00.337478 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d9578dc5-bd32-4b78-8e9a-7a941361653f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:00.343825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d9578dc5-bd32-4b78-8e9a-7a941361653f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:00.344270 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d9578dc5-bd32-4b78-8e9a-7a941361653f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:00.345028 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d9578dc5-bd32-4b78-8e9a-7a941361653f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:00.345493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d9578dc5-bd32-4b78-8e9a-7a941361653f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:00.359078 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-d9578dc5-bd32-4b78-8e9a-7a941361653f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] HTTP exception thrown: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d9578dc5-bd32-4b78-8e9a-7a941361653f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Request method failure captured: Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: DELETE /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 HTTP/1.1 Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48icVbGQpo_IdH8_u62UoQcPfoUo3xwllOW7fjakcJXUphVjQAJzVqE7fI-fsqP3g4NqZjz8YFLyejjO-VLv92lJBWa3RdJ2AtZ841GWsHIbm-PB-ZcSKgDGNNp_FYxiDV5ReNSeL7mFuVa5RErCcpxqZKkcIeuKO_mbw7bKo_jOIw8 Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:53:00.360592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:53:00.362245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4b9969357142bc8724804eb47e0c48", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:53:00.362245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:53:00.362245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:53:00.362245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:53:00.362245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:53:00.362245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:53:00.362245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:53:00.362245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 1a343996462b462d86fb89b876f4e127 Jul 29 11:53:00.362245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:53:00.362245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:53:00.362245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. Jul 29 11:53:00.362245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '5c8a2d21-648a-4b70-badd-2d7e499f5b90'} Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:53:00.363101 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. Jul 29 11:53:00.364650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:00.366148 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d9578dc5-bd32-4b78-8e9a-7a941361653f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Returning 404 to user: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:53:00.366148 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d9578dc5-bd32-4b78-8e9a-7a941361653f tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 404 len: 111 microversion: 2.1 time: 0.029539 Jul 29 11:53:00.366148 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 372/729] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:53:00 2022] DELETE /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:53:00.370541 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-b4b76be7-8c85-4b3f-b862-6781b0b678ee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:00.371162 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-b4b76be7-8c85-4b3f-b862-6781b0b678ee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] [instance: 5c8a2d21-648a-4b70-badd-2d7e499f5b90] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:00.377583 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b4b76be7-8c85-4b3f-b862-6781b0b678ee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:00.378042 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b4b76be7-8c85-4b3f-b862-6781b0b678ee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:00.378814 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b4b76be7-8c85-4b3f-b862-6781b0b678ee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:00.379253 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b4b76be7-8c85-4b3f-b862-6781b0b678ee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:00.392880 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-b4b76be7-8c85-4b3f-b862-6781b0b678ee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] HTTP exception thrown: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-b4b76be7-8c85-4b3f-b862-6781b0b678ee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Request method failure captured: Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 HTTP/1.1 Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48icVbGQpo_IdH8_u62UoQcPfoUo3xwllOW7fjakcJXUphVjQAJzVqE7fI-fsqP3g4NqZjz8YFLyejjO-VLv92lJBWa3RdJ2AtZ841GWsHIbm-PB-ZcSKgDGNNp_FYxiDV5ReNSeL7mFuVa5RErCcpxqZKkcIeuKO_mbw7bKo_jOIw8 Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:53:00.394478 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:53:00.396095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4b9969357142bc8724804eb47e0c48", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4b9969357142bc8724804eb47e0c48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:53:00.396095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:53:00.396095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 6a4b9969357142bc8724804eb47e0c48 Jul 29 11:53:00.396095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1350640603 Jul 29 11:53:00.396095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:53:00.396095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:53:00.396095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:53:00.396095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 1a343996462b462d86fb89b876f4e127 Jul 29 11:53:00.396095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-AttachVolumeNegativeTest-1350640603-project Jul 29 11:53:00.396095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:53:00.396095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. Jul 29 11:53:00.396095 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': '5c8a2d21-648a-4b70-badd-2d7e499f5b90'} Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:53:00.397534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. Jul 29 11:53:00.398751 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:00.399798 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-b4b76be7-8c85-4b3f-b862-6781b0b678ee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] Returning 404 to user: Instance 5c8a2d21-648a-4b70-badd-2d7e499f5b90 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:53:00.399798 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-b4b76be7-8c85-4b3f-b862-6781b0b678ee tempest-AttachVolumeNegativeTest-1350640603 tempest-AttachVolumeNegativeTest-1350640603-project] 10.222.0.60 "GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90" status: 404 len: 111 microversion: 2.1 time: 0.029130 Jul 29 11:53:00.399798 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 358/730] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:00 2022] GET /compute/v2.1/servers/5c8a2d21-648a-4b70-badd-2d7e499f5b90 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:53:02.101878 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-83fd60cc-ce35-48f1-bee4-3e32c27cca2f tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1058753378"}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:53:02.103023 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-83fd60cc-ce35-48f1-bee4-3e32c27cca2f tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:02.109785 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-83fd60cc-ce35-48f1-bee4-3e32c27cca2f tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:02.110249 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-83fd60cc-ce35-48f1-bee4-3e32c27cca2f tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:02.111011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-83fd60cc-ce35-48f1-bee4-3e32c27cca2f tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:02.111447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-83fd60cc-ce35-48f1-bee4-3e32c27cca2f tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:02.253870 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.network.security_group_api [None req-83fd60cc-ce35-48f1-bee4-3e32c27cca2f tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Removing security group a9cd8a1e-b7a0-41a6-b6a4-49419d7a3530 from port 60afe5bb-47c8-40c1-8b64-67d4e2f7c626 Jul 29 11:53:02.622554 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-83fd60cc-ce35-48f1-bee4-3e32c27cca2f tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "POST /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/action" status: 202 len: 0 microversion: 2.1 time: 0.525129 Jul 29 11:53:02.624433 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 373/731] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Jul 29 11:53:02 2022] POST /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:53:02.937743 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-7af0dffd-9448-4527-9481-70ab82a4364a req-89ebb789-f33a-42e0-8c6a-b45c447c3bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f49b2279-4842-4a6c-8dc4-c3429b36f44b", "tag": "60afe5bb-47c8-40c1-8b64-67d4e2f7c626"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:53:02.950718 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-7af0dffd-9448-4527-9481-70ab82a4364a req-89ebb789-f33a-42e0-8c6a-b45c447c3bba service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:02.951670 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-7af0dffd-9448-4527-9481-70ab82a4364a req-89ebb789-f33a-42e0-8c6a-b45c447c3bba service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:02.969004 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-7af0dffd-9448-4527-9481-70ab82a4364a req-89ebb789-f33a-42e0-8c6a-b45c447c3bba service nova] Creating event network-changed:60afe5bb-47c8-40c1-8b64-67d4e2f7c626 for instance f49b2279-4842-4a6c-8dc4-c3429b36f44b on hv-cinder-83754 Jul 29 11:53:02.974627 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-7af0dffd-9448-4527-9481-70ab82a4364a req-89ebb789-f33a-42e0-8c6a-b45c447c3bba service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.344869 Jul 29 11:53:02.976317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 359/732] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:53:03.867120 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e6fda325-5a7a-47c3-95cc-2bfd338b4ac0 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:03.868613 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e6fda325-5a7a-47c3-95cc-2bfd338b4ac0 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:03.876522 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e6fda325-5a7a-47c3-95cc-2bfd338b4ac0 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:03.877285 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e6fda325-5a7a-47c3-95cc-2bfd338b4ac0 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:03.878432 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e6fda325-5a7a-47c3-95cc-2bfd338b4ac0 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:03.879360 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e6fda325-5a7a-47c3-95cc-2bfd338b4ac0 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:03.983208 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-e6fda325-5a7a-47c3-95cc-2bfd338b4ac0 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lazy-loading 'services' on Instance uuid f49b2279-4842-4a6c-8dc4-c3429b36f44b {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:53:04.101768 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e6fda325-5a7a-47c3-95cc-2bfd338b4ac0 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/os-volume_attachments/a6eb560e-828b-475d-bbc9-53b1bf16573a" status: 202 len: 0 microversion: 2.1 time: 0.240557 Jul 29 11:53:04.102394 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 374/733] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Jul 29 11:53:03 2022] DELETE /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/os-volume_attachments/a6eb560e-828b-475d-bbc9-53b1bf16573a => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:53:04.111438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-51de7e21-8205-4757-ac30-b66bbe4b6aab tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:04.113860 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-51de7e21-8205-4757-ac30-b66bbe4b6aab tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:04.128944 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-51de7e21-8205-4757-ac30-b66bbe4b6aab tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:04.129401 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-51de7e21-8205-4757-ac30-b66bbe4b6aab tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:04.130419 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-51de7e21-8205-4757-ac30-b66bbe4b6aab tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:04.135458 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-51de7e21-8205-4757-ac30-b66bbe4b6aab tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:04.197767 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-51de7e21-8205-4757-ac30-b66bbe4b6aab tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090337 Jul 29 11:53:04.198197 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 360/734] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:53:04 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:53:04.993340 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-57f355a5-0d97-4d07-9987-1f233ef21ea9 req-43980747-c01a-4e01-a959-359f9d0a1edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f49b2279-4842-4a6c-8dc4-c3429b36f44b", "tag": "60afe5bb-47c8-40c1-8b64-67d4e2f7c626"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:53:05.003615 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-57f355a5-0d97-4d07-9987-1f233ef21ea9 req-43980747-c01a-4e01-a959-359f9d0a1edc service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:05.004252 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-57f355a5-0d97-4d07-9987-1f233ef21ea9 req-43980747-c01a-4e01-a959-359f9d0a1edc service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:05.016728 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-57f355a5-0d97-4d07-9987-1f233ef21ea9 req-43980747-c01a-4e01-a959-359f9d0a1edc service nova] Creating event network-changed:60afe5bb-47c8-40c1-8b64-67d4e2f7c626 for instance f49b2279-4842-4a6c-8dc4-c3429b36f44b on hv-cinder-83754 Jul 29 11:53:05.021701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-57f355a5-0d97-4d07-9987-1f233ef21ea9 req-43980747-c01a-4e01-a959-359f9d0a1edc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033722 Jul 29 11:53:05.022304 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 375/735] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:53:05.210738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9913b931-bf61-4433-b4ec-511f43592f04 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:05.212958 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9913b931-bf61-4433-b4ec-511f43592f04 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:05.219667 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9913b931-bf61-4433-b4ec-511f43592f04 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:05.220125 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9913b931-bf61-4433-b4ec-511f43592f04 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:05.220902 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9913b931-bf61-4433-b4ec-511f43592f04 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:05.221359 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9913b931-bf61-4433-b4ec-511f43592f04 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:05.255401 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9913b931-bf61-4433-b4ec-511f43592f04 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048623 Jul 29 11:53:05.256079 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 361/736] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:53:05 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 11:53:05.269030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e13367ab-1009-4054-88da-5708a9727eb8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:05.270760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e13367ab-1009-4054-88da-5708a9727eb8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:05.277854 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e13367ab-1009-4054-88da-5708a9727eb8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:05.278391 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e13367ab-1009-4054-88da-5708a9727eb8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:05.279192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e13367ab-1009-4054-88da-5708a9727eb8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:05.279639 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e13367ab-1009-4054-88da-5708a9727eb8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:05.370170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-e13367ab-1009-4054-88da-5708a9727eb8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] HTTP exception thrown: Instance f49b2279-4842-4a6c-8dc4-c3429b36f44b is not attached to volume a6eb560e-828b-475d-bbc9-53b1bf16573a Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e13367ab-1009-4054-88da-5708a9727eb8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Request method failure captured: Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: DELETE /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/os-volume_attachments/a6eb560e-828b-475d-bbc9-53b1bf16573a HTTP/1.1 Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48mcb75UbSW4IUHBA0nR9AZP96yGKTcww6yXitPDcysXpK6utOsTL1_BzOzCy74LQFwSSkgmRNQ2CZ-_leZvP3dJCzaV0cCJCwt7lH2q_aAxXG4Tz6kRKec-u8U8twRsd6knSh8e-PJqxNO5IJjIak5rgi3EdV5rK5jWlRj6Fo0yWIY Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 861c5a0403c94abd9ae479175604c835 Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-TestMinimumBasicScenario-175981902 Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:53:05.372771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:53:05.374358 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/861c5a0403c94abd9ae479175604c835"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_861c5a0403c94abd9ae479175604c835", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/861c5a0403c94abd9ae479175604c835"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/861c5a0403c94abd9ae479175604c835"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:53:05.374358 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-TestMinimumBasicScenario-175981902 Jul 29 11:53:05.374358 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 861c5a0403c94abd9ae479175604c835 Jul 29 11:53:05.374358 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-TestMinimumBasicScenario-175981902 Jul 29 11:53:05.374358 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-TestMinimumBasicScenario-175981902-project Jul 29 11:53:05.374358 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:53:05.374358 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:53:05.374358 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 5c56880b1a64449e8e0de42174222600 Jul 29 11:53:05.374358 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-TestMinimumBasicScenario-175981902-project Jul 29 11:53:05.374358 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:53:05.374358 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance f49b2279-4842-4a6c-8dc4-c3429b36f44b is not attached to volume a6eb560e-828b-475d-bbc9-53b1bf16573a Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'server_id': 'f49b2279-4842-4a6c-8dc4-c3429b36f44b', 'id': 'a6eb560e-828b-475d-bbc9-53b1bf16573a'} Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a6eb560e-828b-475d-bbc9-53b1bf16573a. Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:53:05.375254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:53:05.376630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:53:05.376630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 29 11:53:05.376630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 29 11:53:05.376630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f49b2279-4842-4a6c-8dc4-c3429b36f44b is not attached to volume a6eb560e-828b-475d-bbc9-53b1bf16573a Jul 29 11:53:05.376630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.376630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.376630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.376630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.376630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:05.376630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:05.376630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:53:05.376630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:53:05.376630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f49b2279-4842-4a6c-8dc4-c3429b36f44b is not attached to volume a6eb560e-828b-475d-bbc9-53b1bf16573a Jul 29 11:53:05.376630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.376630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e13367ab-1009-4054-88da-5708a9727eb8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Returning 404 to user: Instance f49b2279-4842-4a6c-8dc4-c3429b36f44b is not attached to volume a6eb560e-828b-475d-bbc9-53b1bf16573a {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:53:05.378609 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e13367ab-1009-4054-88da-5708a9727eb8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/os-volume_attachments/a6eb560e-828b-475d-bbc9-53b1bf16573a" status: 404 len: 154 microversion: 2.1 time: 0.115540 Jul 29 11:53:05.379292 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 376/737] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Jul 29 11:53:05 2022] DELETE /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b/os-volume_attachments/a6eb560e-828b-475d-bbc9-53b1bf16573a => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:53:05.696433 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-312e5125-8dea-48ff-bcc8-78d54d124ed1 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Action: 'create', calling method: .version_select at 0x7f68f9e58f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1439980510", "metadata": {"Type": "work"}}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-312e5125-8dea-48ff-bcc8-78d54d124ed1 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Request method failure captured: Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 122 Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48ohUE8qzT0quP7GHz2UM6ziUWLd4Y4nBOF_7vQHPuGmNwNbTPqeKjZCUC9g37N5gEK4SqnEFjghEDXqcy8IQWi8KDP0DDPPVtM4Eeu9femVCAe_8r-ycFaMKdyFesBYkteyJ5Qsn--_mvgw3QWE2M7ZGMCHe-PbQGlSjemVfNS8IQQ Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: a33ad5eb2d4849b5bf95011b7a17d562 Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:53:05.706941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:53:05.708530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a33ad5eb2d4849b5bf95011b7a17d562", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:53:05.708530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.708530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: a33ad5eb2d4849b5bf95011b7a17d562 Jul 29 11:53:05.708530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.708530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-VolumesNegativeTest-310033190-project Jul 29 11:53:05.708530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:53:05.708530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:53:05.708530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 8c14f0f1a729492f8fac45a794652166 Jul 29 11:53:05.708530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-VolumesNegativeTest-310033190-project Jul 29 11:53:05.708530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Jul 29 11:53:05.708530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1439980510", "metadata": {"Type": "work"}}} Jul 29 11:53:05.708530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: Jul 29 11:53:05.708530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1439980510', 'metadata': {'Type': 'work'}}}} Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise error Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi '#$%' Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:53:05.710087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 11:53:05.711717 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 11:53:05.713013 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 11:53:05.713013 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.713013 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-312e5125-8dea-48ff-bcc8-78d54d124ed1 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:53:05.713013 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-312e5125-8dea-48ff-bcc8-78d54d124ed1 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.150833 Jul 29 11:53:05.713013 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 362/738] 10.222.0.60 () {60 vars in 1156 bytes} [Fri Jul 29 11:53:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 11:53:05.722122 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3f897c57-7a8c-4062-9c9f-74ed76ac4f86 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Action: 'create', calling method: .version_select at 0x7f68f9fc6ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-896229461", "metadata": {"Type": "work"}}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3f897c57-7a8c-4062-9c9f-74ed76ac4f86 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Request method failure captured: Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 119 Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48ohUE8qzT0quP7GHz2UM6ziUWLd4Y4nBOF_7vQHPuGmNwNbTPqeKjZCUC9g37N5gEK4SqnEFjghEDXqcy8IQWi8KDP0DDPPVtM4Eeu9femVCAe_8r-ycFaMKdyFesBYkteyJ5Qsn--_mvgw3QWE2M7ZGMCHe-PbQGlSjemVfNS8IQQ Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: a33ad5eb2d4849b5bf95011b7a17d562 Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:53:05.727689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:53:05.729036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a33ad5eb2d4849b5bf95011b7a17d562", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:53:05.729036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.729036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: a33ad5eb2d4849b5bf95011b7a17d562 Jul 29 11:53:05.729036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.729036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-VolumesNegativeTest-310033190-project Jul 29 11:53:05.729036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:53:05.729036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:53:05.729036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 8c14f0f1a729492f8fac45a794652166 Jul 29 11:53:05.729036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-VolumesNegativeTest-310033190-project Jul 29 11:53:05.729036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Jul 29 11:53:05.729036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-896229461", "metadata": {"Type": "work"}}} Jul 29 11:53:05.729036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: Jul 29 11:53:05.729036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-896229461', 'metadata': {'Type': 'work'}}}} Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise error Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi '0' Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:53:05.730115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 11:53:05.731493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 11:53:05.734074 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 11:53:05.734074 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.734074 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3f897c57-7a8c-4062-9c9f-74ed76ac4f86 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:53:05.734074 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3f897c57-7a8c-4062-9c9f-74ed76ac4f86 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010891 Jul 29 11:53:05.734074 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 377/739] 10.222.0.60 () {60 vars in 1156 bytes} [Fri Jul 29 11:53:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 11:53:05.739637 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4ef6fb20-d11b-44fb-9ccc-bb0607babedb tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Action: 'create', calling method: .version_select at 0x7f68f9e8cb80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1842664940", "metadata": {"Type": "work"}}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4ef6fb20-d11b-44fb-9ccc-bb0607babedb tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Request method failure captured: Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 119 Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48ohUE8qzT0quP7GHz2UM6ziUWLd4Y4nBOF_7vQHPuGmNwNbTPqeKjZCUC9g37N5gEK4SqnEFjghEDXqcy8IQWi8KDP0DDPPVtM4Eeu9femVCAe_8r-ycFaMKdyFesBYkteyJ5Qsn--_mvgw3QWE2M7ZGMCHe-PbQGlSjemVfNS8IQQ Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: a33ad5eb2d4849b5bf95011b7a17d562 Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:53:05.743643 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:53:05.745171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a33ad5eb2d4849b5bf95011b7a17d562", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:53:05.745171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.745171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: a33ad5eb2d4849b5bf95011b7a17d562 Jul 29 11:53:05.745171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.745171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-VolumesNegativeTest-310033190-project Jul 29 11:53:05.745171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:53:05.745171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:53:05.745171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 8c14f0f1a729492f8fac45a794652166 Jul 29 11:53:05.745171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-VolumesNegativeTest-310033190-project Jul 29 11:53:05.745171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Jul 29 11:53:05.745171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1842664940", "metadata": {"Type": "work"}}} Jul 29 11:53:05.745171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: Jul 29 11:53:05.745171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1842664940', 'metadata': {'Type': 'work'}}}} Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise error Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi '' Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:53:05.746134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 11:53:05.747671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 11:53:05.748806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 11:53:05.748806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.748806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4ef6fb20-d11b-44fb-9ccc-bb0607babedb tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:53:05.748806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4ef6fb20-d11b-44fb-9ccc-bb0607babedb tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009669 Jul 29 11:53:05.748806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 363/740] 10.222.0.60 () {60 vars in 1156 bytes} [Fri Jul 29 11:53:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 11:53:05.755091 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-aa6a55fc-05c5-4ae7-a414-c442f873a36e tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Calling method '.version_select at 0x7f68f9ee7820>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:05.785131 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-aa6a55fc-05c5-4ae7-a414-c442f873a36e tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] HTTP exception thrown: Volume tempest-invalid-2072063236 could not be found. Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-aa6a55fc-05c5-4ae7-a414-c442f873a36e tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Request method failure captured: Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2072063236 HTTP/1.1 Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48ohUE8qzT0quP7GHz2UM6ziUWLd4Y4nBOF_7vQHPuGmNwNbTPqeKjZCUC9g37N5gEK4SqnEFjghEDXqcy8IQWi8KDP0DDPPVtM4Eeu9femVCAe_8r-ycFaMKdyFesBYkteyJ5Qsn--_mvgw3QWE2M7ZGMCHe-PbQGlSjemVfNS8IQQ Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: a33ad5eb2d4849b5bf95011b7a17d562 Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:53:05.787123 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:53:05.789143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a33ad5eb2d4849b5bf95011b7a17d562", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:53:05.789143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.789143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: a33ad5eb2d4849b5bf95011b7a17d562 Jul 29 11:53:05.789143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.789143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-VolumesNegativeTest-310033190-project Jul 29 11:53:05.789143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:53:05.789143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:53:05.789143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 8c14f0f1a729492f8fac45a794652166 Jul 29 11:53:05.789143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-VolumesNegativeTest-310033190-project Jul 29 11:53:05.789143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: Jul 29 11:53:05.789143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Volume tempest-invalid-2072063236 could not be found. Jul 29 11:53:05.789143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': 'tempest-invalid-2072063236'} Jul 29 11:53:05.789143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2072063236 could not be found. (HTTP 404) (Request-ID: req-3faa0138-f82d-4773-b016-49e7ffca440a) Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.790090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 11:53:05.791463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2072063236 could not be found. Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:53:05.794261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2072063236 could not be found. Jul 29 11:53:05.795644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.795644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.795644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.795644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.795644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:05.795644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:05.795644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:53:05.795644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:53:05.795644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2072063236 could not be found. Jul 29 11:53:05.795644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.795644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-aa6a55fc-05c5-4ae7-a414-c442f873a36e tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Returning 404 to user: Volume tempest-invalid-2072063236 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:53:05.795644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-aa6a55fc-05c5-4ae7-a414-c442f873a36e tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2072063236" status: 404 len: 99 microversion: 2.1 time: 0.037760 Jul 29 11:53:05.795644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 378/741] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Jul 29 11:53:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2072063236 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 29 11:53:05.799670 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-071bbdc4-4cd8-4595-8344-d4f5405e2630 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003737 Jul 29 11:53:05.800170 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 364/742] 10.222.0.60 () {58 vars in 1140 bytes} [Fri Jul 29 11:53:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 29 11:53:05.808942 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f2313336-2aa4-4c45-9646-f6102277a014 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003824 Jul 29 11:53:05.809596 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 379/743] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Jul 29 11:53:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 29 11:53:05.817907 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-98d1c943-3237-48c5-9faf-8dbb003c7a81 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Calling method '.version_select at 0x7f68f9ef73a0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:05.846353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-98d1c943-3237-48c5-9faf-8dbb003c7a81 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] HTTP exception thrown: Volume 5e1ea41b-c60c-44d8-b97d-823591c77af9 could not be found. Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-98d1c943-3237-48c5-9faf-8dbb003c7a81 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Request method failure captured: Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: DELETE /compute/v2.1/os-volumes/5e1ea41b-c60c-44d8-b97d-823591c77af9 HTTP/1.1 Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48ohUE8qzT0quP7GHz2UM6ziUWLd4Y4nBOF_7vQHPuGmNwNbTPqeKjZCUC9g37N5gEK4SqnEFjghEDXqcy8IQWi8KDP0DDPPVtM4Eeu9femVCAe_8r-ycFaMKdyFesBYkteyJ5Qsn--_mvgw3QWE2M7ZGMCHe-PbQGlSjemVfNS8IQQ Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: a33ad5eb2d4849b5bf95011b7a17d562 Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:53:05.849684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:53:05.852143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a33ad5eb2d4849b5bf95011b7a17d562", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:53:05.852143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.852143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: a33ad5eb2d4849b5bf95011b7a17d562 Jul 29 11:53:05.852143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.852143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-VolumesNegativeTest-310033190-project Jul 29 11:53:05.852143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:53:05.852143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:53:05.852143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 8c14f0f1a729492f8fac45a794652166 Jul 29 11:53:05.852143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-VolumesNegativeTest-310033190-project Jul 29 11:53:05.852143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: Jul 29 11:53:05.852143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Volume 5e1ea41b-c60c-44d8-b97d-823591c77af9 could not be found. Jul 29 11:53:05.852143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': '5e1ea41b-c60c-44d8-b97d-823591c77af9'} Jul 29 11:53:05.852143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5e1ea41b-c60c-44d8-b97d-823591c77af9 could not be found. (HTTP 404) (Request-ID: req-560400ef-11ac-4946-96e5-85dab99cc1d3) Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.853129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 11:53:05.854502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5e1ea41b-c60c-44d8-b97d-823591c77af9 could not be found. Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 11:53:05.855886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:53:05.857438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5e1ea41b-c60c-44d8-b97d-823591c77af9 could not be found. Jul 29 11:53:05.857438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.857438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.857438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.857438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.857438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:05.857438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:05.857438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:53:05.857438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:53:05.857438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5e1ea41b-c60c-44d8-b97d-823591c77af9 could not be found. Jul 29 11:53:05.857438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.857438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-98d1c943-3237-48c5-9faf-8dbb003c7a81 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Returning 404 to user: Volume 5e1ea41b-c60c-44d8-b97d-823591c77af9 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:53:05.857438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-98d1c943-3237-48c5-9faf-8dbb003c7a81 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/5e1ea41b-c60c-44d8-b97d-823591c77af9" status: 404 len: 109 microversion: 2.1 time: 0.037466 Jul 29 11:53:05.857438 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 365/744] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Jul 29 11:53:05 2022] DELETE /compute/v2.1/os-volumes/5e1ea41b-c60c-44d8-b97d-823591c77af9 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:53:05.861297 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-724c18d5-7dd1-4939-84bc-01bf752b18f7 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Calling method '.version_select at 0x7f68fa309f70>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:05.891496 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-724c18d5-7dd1-4939-84bc-01bf752b18f7 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] HTTP exception thrown: Volume ebc2ac0f-5379-4246-be7d-e4648b2b65e1 could not be found. Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-724c18d5-7dd1-4939-84bc-01bf752b18f7 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Request method failure captured: Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/os-volumes/ebc2ac0f-5379-4246-be7d-e4648b2b65e1 HTTP/1.1 Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48ohUE8qzT0quP7GHz2UM6ziUWLd4Y4nBOF_7vQHPuGmNwNbTPqeKjZCUC9g37N5gEK4SqnEFjghEDXqcy8IQWi8KDP0DDPPVtM4Eeu9femVCAe_8r-ycFaMKdyFesBYkteyJ5Qsn--_mvgw3QWE2M7ZGMCHe-PbQGlSjemVfNS8IQQ Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: a33ad5eb2d4849b5bf95011b7a17d562 Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:53:05.893466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:53:05.895030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a33ad5eb2d4849b5bf95011b7a17d562", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a33ad5eb2d4849b5bf95011b7a17d562"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:53:05.895030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.895030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: a33ad5eb2d4849b5bf95011b7a17d562 Jul 29 11:53:05.895030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-VolumesNegativeTest-310033190 Jul 29 11:53:05.895030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-VolumesNegativeTest-310033190-project Jul 29 11:53:05.895030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:53:05.895030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:53:05.895030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 8c14f0f1a729492f8fac45a794652166 Jul 29 11:53:05.895030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-VolumesNegativeTest-310033190-project Jul 29 11:53:05.895030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: Jul 29 11:53:05.895030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Volume ebc2ac0f-5379-4246-be7d-e4648b2b65e1 could not be found. Jul 29 11:53:05.895030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': 'ebc2ac0f-5379-4246-be7d-e4648b2b65e1'} Jul 29 11:53:05.895030 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ebc2ac0f-5379-4246-be7d-e4648b2b65e1 could not be found. (HTTP 404) (Request-ID: req-e17c5381-0452-4e65-bbbb-5b1ccc7a3f91) Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.896149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 11:53:05.897745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ebc2ac0f-5379-4246-be7d-e4648b2b65e1 could not be found. Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 11:53:05.899021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:53:05.900425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ebc2ac0f-5379-4246-be7d-e4648b2b65e1 could not be found. Jul 29 11:53:05.900425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.900425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:05.900425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.900425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:05.900425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:05.900425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:05.900425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:53:05.900425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:53:05.900425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ebc2ac0f-5379-4246-be7d-e4648b2b65e1 could not be found. Jul 29 11:53:05.900425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:05.900425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-724c18d5-7dd1-4939-84bc-01bf752b18f7 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] Returning 404 to user: Volume ebc2ac0f-5379-4246-be7d-e4648b2b65e1 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:53:05.900425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-724c18d5-7dd1-4939-84bc-01bf752b18f7 tempest-VolumesNegativeTest-310033190 tempest-VolumesNegativeTest-310033190-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ebc2ac0f-5379-4246-be7d-e4648b2b65e1" status: 404 len: 109 microversion: 2.1 time: 0.037436 Jul 29 11:53:05.900425 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 380/745] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Jul 29 11:53:05 2022] GET /compute/v2.1/os-volumes/ebc2ac0f-5379-4246-be7d-e4648b2b65e1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:53:06.532231 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-3b9b695d-b24b-4f9b-b264-28e67d6f7984 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:06.533269 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-3b9b695d-b24b-4f9b-b264-28e67d6f7984 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:06.547148 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3b9b695d-b24b-4f9b-b264-28e67d6f7984 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:06.547632 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3b9b695d-b24b-4f9b-b264-28e67d6f7984 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:06.548440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3b9b695d-b24b-4f9b-b264-28e67d6f7984 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:06.548884 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3b9b695d-b24b-4f9b-b264-28e67d6f7984 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:06.575215 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-3b9b695d-b24b-4f9b-b264-28e67d6f7984 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Going to try to terminate instance {{(pid=129585) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:53:06.654354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-3b9b695d-b24b-4f9b-b264-28e67d6f7984 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 204 len: 0 microversion: 2.1 time: 0.126225 Jul 29 11:53:06.655084 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 366/746] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:53:06 2022] DELETE /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:53:06.664618 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-2fa3bd58-7d6f-4e77-839e-ed2ce5974961 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:06.665423 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-2fa3bd58-7d6f-4e77-839e-ed2ce5974961 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:06.671673 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2fa3bd58-7d6f-4e77-839e-ed2ce5974961 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:06.672131 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2fa3bd58-7d6f-4e77-839e-ed2ce5974961 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:06.672910 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2fa3bd58-7d6f-4e77-839e-ed2ce5974961 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:06.673349 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2fa3bd58-7d6f-4e77-839e-ed2ce5974961 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:06.816254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2fa3bd58-7d6f-4e77-839e-ed2ce5974961 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:06.829092 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-2fa3bd58-7d6f-4e77-839e-ed2ce5974961 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1554 microversion: 2.1 time: 0.169592 Jul 29 11:53:06.829697 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 381/747] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:06 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:53:07.691337 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6a9b5496-f779-4304-9b19-0fc0b2682a9d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:07.694834 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6a9b5496-f779-4304-9b19-0fc0b2682a9d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:07.702197 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6a9b5496-f779-4304-9b19-0fc0b2682a9d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:07.702740 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6a9b5496-f779-4304-9b19-0fc0b2682a9d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:07.703447 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6a9b5496-f779-4304-9b19-0fc0b2682a9d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:07.703880 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6a9b5496-f779-4304-9b19-0fc0b2682a9d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:07.733803 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6a9b5496-f779-4304-9b19-0fc0b2682a9d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046803 Jul 29 11:53:07.734400 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 367/748] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Jul 29 11:53:07 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:07.796639 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-2904246f-9c3f-4abe-9ce1-27cda26db04a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:07.797181 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-2904246f-9c3f-4abe-9ce1-27cda26db04a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:07.804218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2904246f-9c3f-4abe-9ce1-27cda26db04a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:07.804679 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2904246f-9c3f-4abe-9ce1-27cda26db04a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:07.805486 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2904246f-9c3f-4abe-9ce1-27cda26db04a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:07.805939 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2904246f-9c3f-4abe-9ce1-27cda26db04a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:07.832158 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-2904246f-9c3f-4abe-9ce1-27cda26db04a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Going to try to terminate instance {{(pid=129584) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:53:07.851565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-21bbc92e-9da5-4e62-a7f7-56a3577a8c22 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:07.852171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-21bbc92e-9da5-4e62-a7f7-56a3577a8c22 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:07.859195 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-21bbc92e-9da5-4e62-a7f7-56a3577a8c22 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:07.859195 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-21bbc92e-9da5-4e62-a7f7-56a3577a8c22 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:07.860214 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-21bbc92e-9da5-4e62-a7f7-56a3577a8c22 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:07.860861 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-21bbc92e-9da5-4e62-a7f7-56a3577a8c22 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:07.925811 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-2904246f-9c3f-4abe-9ce1-27cda26db04a tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "DELETE /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 204 len: 0 microversion: 2.20 time: 0.132618 Jul 29 11:53:07.926659 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 382/749] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Jul 29 11:53:07 2022] DELETE /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 11:53:07.936279 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-fa5ff4d4-662f-4719-ad39-8ba26a5e03f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:07.936988 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-fa5ff4d4-662f-4719-ad39-8ba26a5e03f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:07.943122 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fa5ff4d4-662f-4719-ad39-8ba26a5e03f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:07.944160 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fa5ff4d4-662f-4719-ad39-8ba26a5e03f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:07.944997 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fa5ff4d4-662f-4719-ad39-8ba26a5e03f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:07.945451 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fa5ff4d4-662f-4719-ad39-8ba26a5e03f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:08.033623 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-21bbc92e-9da5-4e62-a7f7-56a3577a8c22 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:08.042108 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-21bbc92e-9da5-4e62-a7f7-56a3577a8c22 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1554 microversion: 2.1 time: 0.194316 Jul 29 11:53:08.042689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 368/750] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:07 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:53:08.110418 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-fa5ff4d4-662f-4719-ad39-8ba26a5e03f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:08.119022 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-fa5ff4d4-662f-4719-ad39-8ba26a5e03f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:08.120540 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-fa5ff4d4-662f-4719-ad39-8ba26a5e03f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:08.121753 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-fa5ff4d4-662f-4719-ad39-8ba26a5e03f4 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.190091 Jul 29 11:53:08.122565 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 383/751] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:53:07 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:53:09.068094 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e7c3ab82-7b72-4f02-8375-87c4aa86b180 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:09.069195 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e7c3ab82-7b72-4f02-8375-87c4aa86b180 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:09.075887 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e7c3ab82-7b72-4f02-8375-87c4aa86b180 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:09.076340 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e7c3ab82-7b72-4f02-8375-87c4aa86b180 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:09.077103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e7c3ab82-7b72-4f02-8375-87c4aa86b180 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:09.077581 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e7c3ab82-7b72-4f02-8375-87c4aa86b180 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:09.148077 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5a2e659d-ce0f-4371-9024-f3476c0846a0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:09.149216 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-5a2e659d-ce0f-4371-9024-f3476c0846a0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:09.156084 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5a2e659d-ce0f-4371-9024-f3476c0846a0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:09.156548 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5a2e659d-ce0f-4371-9024-f3476c0846a0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:09.157331 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5a2e659d-ce0f-4371-9024-f3476c0846a0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:09.157796 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5a2e659d-ce0f-4371-9024-f3476c0846a0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:09.227834 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e7c3ab82-7b72-4f02-8375-87c4aa86b180 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:09.231711 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:09.237013 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e7c3ab82-7b72-4f02-8375-87c4aa86b180 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1554 microversion: 2.1 time: 0.172668 Jul 29 11:53:09.237703 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 369/752] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:09 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:09.312390 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5a2e659d-ce0f-4371-9024-f3476c0846a0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:09.322381 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5a2e659d-ce0f-4371-9024-f3476c0846a0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:09.323812 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5a2e659d-ce0f-4371-9024-f3476c0846a0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:09.325057 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-5a2e659d-ce0f-4371-9024-f3476c0846a0 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.182018 Jul 29 11:53:09.325799 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 384/753] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:53:09 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:53:10.259913 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-f6e98feb-7255-464c-9279-5e55e3696c46 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:10.260774 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-f6e98feb-7255-464c-9279-5e55e3696c46 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:10.269093 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f6e98feb-7255-464c-9279-5e55e3696c46 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:10.269572 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f6e98feb-7255-464c-9279-5e55e3696c46 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:10.270378 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f6e98feb-7255-464c-9279-5e55e3696c46 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:10.270815 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f6e98feb-7255-464c-9279-5e55e3696c46 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:10.350482 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d6131f28-2038-4689-b231-54913370968d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:10.351088 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d6131f28-2038-4689-b231-54913370968d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:10.357182 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d6131f28-2038-4689-b231-54913370968d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:10.357854 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d6131f28-2038-4689-b231-54913370968d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:10.358780 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d6131f28-2038-4689-b231-54913370968d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:10.359374 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d6131f28-2038-4689-b231-54913370968d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:10.363788 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:10.710932 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-f6e98feb-7255-464c-9279-5e55e3696c46 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:10.719593 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-f6e98feb-7255-464c-9279-5e55e3696c46 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1554 microversion: 2.1 time: 0.464545 Jul 29 11:53:10.720447 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 370/754] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:10 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1554 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:10.726430 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-1c2e7abe-42fe-44e8-881d-580c69268b8b req-157defaa-eed3-40b2-8bff-3bf9551448cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f49b2279-4842-4a6c-8dc4-c3429b36f44b", "name": "network-vif-deleted", "tag": "60afe5bb-47c8-40c1-8b64-67d4e2f7c626"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:53:10.743231 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-1c2e7abe-42fe-44e8-881d-580c69268b8b req-157defaa-eed3-40b2-8bff-3bf9551448cf service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:10.743687 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-1c2e7abe-42fe-44e8-881d-580c69268b8b req-157defaa-eed3-40b2-8bff-3bf9551448cf service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:10.767141 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-1c2e7abe-42fe-44e8-881d-580c69268b8b req-157defaa-eed3-40b2-8bff-3bf9551448cf service nova] Creating event network-vif-deleted:60afe5bb-47c8-40c1-8b64-67d4e2f7c626 for instance f49b2279-4842-4a6c-8dc4-c3429b36f44b on hv-cinder-83754 Jul 29 11:53:10.779247 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-1c2e7abe-42fe-44e8-881d-580c69268b8b req-157defaa-eed3-40b2-8bff-3bf9551448cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057187 Jul 29 11:53:10.780881 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 371/755] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:53:10.785743 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d6131f28-2038-4689-b231-54913370968d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:10.795143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d6131f28-2038-4689-b231-54913370968d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:10.796667 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d6131f28-2038-4689-b231-54913370968d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:10.798154 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d6131f28-2038-4689-b231-54913370968d tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1724 microversion: 2.20 time: 0.452406 Jul 29 11:53:10.798717 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 385/756] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:53:10 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1724 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:53:11.745224 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-45dcf6af-de1b-434d-8e8b-cf24cb1b5cca tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:11.745954 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-45dcf6af-de1b-434d-8e8b-cf24cb1b5cca tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:11.752134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-45dcf6af-de1b-434d-8e8b-cf24cb1b5cca tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:11.752593 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-45dcf6af-de1b-434d-8e8b-cf24cb1b5cca tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:11.753363 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-45dcf6af-de1b-434d-8e8b-cf24cb1b5cca tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:11.753831 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-45dcf6af-de1b-434d-8e8b-cf24cb1b5cca tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:11.785502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-45dcf6af-de1b-434d-8e8b-cf24cb1b5cca tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:11.785963 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-45dcf6af-de1b-434d-8e8b-cf24cb1b5cca tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:11.786422 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.objects.instance [None req-45dcf6af-de1b-434d-8e8b-cf24cb1b5cca tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lazy-loading 'fault' on Instance uuid f49b2279-4842-4a6c-8dc4-c3429b36f44b {{(pid=129585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:53:11.822783 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-af29c54a-ccfe-4a2f-bdab-743f00157b57 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:11.823413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-af29c54a-ccfe-4a2f-bdab-743f00157b57 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:11.832270 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-45dcf6af-de1b-434d-8e8b-cf24cb1b5cca tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:11.832648 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-af29c54a-ccfe-4a2f-bdab-743f00157b57 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:11.833108 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-af29c54a-ccfe-4a2f-bdab-743f00157b57 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:11.833955 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-af29c54a-ccfe-4a2f-bdab-743f00157b57 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:11.834552 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-af29c54a-ccfe-4a2f-bdab-743f00157b57 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:11.840137 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-45dcf6af-de1b-434d-8e8b-cf24cb1b5cca tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1348 microversion: 2.1 time: 0.100080 Jul 29 11:53:11.840941 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 372/757] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:11 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:11.900734 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-af29c54a-ccfe-4a2f-bdab-743f00157b57 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:11.909358 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-af29c54a-ccfe-4a2f-bdab-743f00157b57 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:11.910751 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-af29c54a-ccfe-4a2f-bdab-743f00157b57 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:11.912216 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-af29c54a-ccfe-4a2f-bdab-743f00157b57 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1365 microversion: 2.20 time: 0.094107 Jul 29 11:53:11.912744 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 386/758] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:53:11 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1365 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:53:12.797703 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-64f70290-5105-455d-b0cd-80babfbdeb57 req-700e8a7a-1da8-4793-bdb6-b02658da5dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b28697-8f3b-4087-ae1b-836eb376d11b", "name": "network-vif-deleted", "tag": "d99e2239-1b7e-46f6-b919-e3f8a7ca8642"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:53:12.808994 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-64f70290-5105-455d-b0cd-80babfbdeb57 req-700e8a7a-1da8-4793-bdb6-b02658da5dbf service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:12.809499 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-64f70290-5105-455d-b0cd-80babfbdeb57 req-700e8a7a-1da8-4793-bdb6-b02658da5dbf service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:12.828906 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-64f70290-5105-455d-b0cd-80babfbdeb57 req-700e8a7a-1da8-4793-bdb6-b02658da5dbf service nova] Creating event network-vif-deleted:d99e2239-1b7e-46f6-b919-e3f8a7ca8642 for instance 21b28697-8f3b-4087-ae1b-836eb376d11b on hv-cinder-83754 Jul 29 11:53:12.834128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-64f70290-5105-455d-b0cd-80babfbdeb57 req-700e8a7a-1da8-4793-bdb6-b02658da5dbf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040529 Jul 29 11:53:12.834963 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 373/759] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:53:12.861607 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-75a48642-1236-4ac0-9a2a-cb113b3579c8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:12.862224 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-75a48642-1236-4ac0-9a2a-cb113b3579c8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:12.869901 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-75a48642-1236-4ac0-9a2a-cb113b3579c8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:12.870353 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-75a48642-1236-4ac0-9a2a-cb113b3579c8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:12.871114 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-75a48642-1236-4ac0-9a2a-cb113b3579c8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:12.871548 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-75a48642-1236-4ac0-9a2a-cb113b3579c8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:12.903162 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-75a48642-1236-4ac0-9a2a-cb113b3579c8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:12.903610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-75a48642-1236-4ac0-9a2a-cb113b3579c8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:12.904064 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-75a48642-1236-4ac0-9a2a-cb113b3579c8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lazy-loading 'fault' on Instance uuid f49b2279-4842-4a6c-8dc4-c3429b36f44b {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:53:12.936030 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-49907cf5-0f5a-443b-b785-6815b929ba78 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:12.937100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-49907cf5-0f5a-443b-b785-6815b929ba78 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:12.943687 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-49907cf5-0f5a-443b-b785-6815b929ba78 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:12.944449 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-49907cf5-0f5a-443b-b785-6815b929ba78 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:12.945032 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-75a48642-1236-4ac0-9a2a-cb113b3579c8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c56880b1a64449e8e0de42174222600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861c5a0403c94abd9ae479175604c835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:12.945406 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-49907cf5-0f5a-443b-b785-6815b929ba78 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:12.945876 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-49907cf5-0f5a-443b-b785-6815b929ba78 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:12.953331 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-75a48642-1236-4ac0-9a2a-cb113b3579c8 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 200 len: 1348 microversion: 2.1 time: 0.095667 Jul 29 11:53:12.953928 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 387/760] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:12 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:12.978830 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-49907cf5-0f5a-443b-b785-6815b929ba78 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:12.979306 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-49907cf5-0f5a-443b-b785-6815b929ba78 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:12.979747 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.objects.instance [None req-49907cf5-0f5a-443b-b785-6815b929ba78 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lazy-loading 'fault' on Instance uuid 21b28697-8f3b-4087-ae1b-836eb376d11b {{(pid=129585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:53:13.021825 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-49907cf5-0f5a-443b-b785-6815b929ba78 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:13.029639 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-49907cf5-0f5a-443b-b785-6815b929ba78 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:13.031151 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-49907cf5-0f5a-443b-b785-6815b929ba78 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee3506015d9240258cbada860704dffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90047b9130334326ad98280a8edb2bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:13.032311 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-49907cf5-0f5a-443b-b785-6815b929ba78 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 200 len: 1370 microversion: 2.20 time: 0.101002 Jul 29 11:53:13.032870 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 374/761] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:53:12 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 1370 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 11:53:13.976054 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9c8b8559-1077-43a1-8d2b-d958ea9ab598 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:13.976673 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-9c8b8559-1077-43a1-8d2b-d958ea9ab598 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] [instance: f49b2279-4842-4a6c-8dc4-c3429b36f44b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:13.979000 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:13.985117 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9c8b8559-1077-43a1-8d2b-d958ea9ab598 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:13.985653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9c8b8559-1077-43a1-8d2b-d958ea9ab598 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:13.986436 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9c8b8559-1077-43a1-8d2b-d958ea9ab598 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:13.986880 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9c8b8559-1077-43a1-8d2b-d958ea9ab598 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:14.005598 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-9c8b8559-1077-43a1-8d2b-d958ea9ab598 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] HTTP exception thrown: Instance f49b2279-4842-4a6c-8dc4-c3429b36f44b could not be found. Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9c8b8559-1077-43a1-8d2b-d958ea9ab598 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Request method failure captured: Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b HTTP/1.1 Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48mcb75UbSW4IUHBA0nR9AZP96yGKTcww6yXitPDcysXpK6utOsTL1_BzOzCy74LQFwSSkgmRNQ2CZ-_leZvP3dJCzaV0cCJCwt7lH2q_aAxXG4Tz6kRKec-u8U8twRsd6knSh8e-PJqxNO5IJjIak5rgi3EdV5rK5jWlRj6Fo0yWIY Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 861c5a0403c94abd9ae479175604c835 Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-TestMinimumBasicScenario-175981902 Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:53:14.007913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:53:14.009845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/861c5a0403c94abd9ae479175604c835"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_861c5a0403c94abd9ae479175604c835", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/861c5a0403c94abd9ae479175604c835"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/861c5a0403c94abd9ae479175604c835"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:53:14.009845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-TestMinimumBasicScenario-175981902 Jul 29 11:53:14.009845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 861c5a0403c94abd9ae479175604c835 Jul 29 11:53:14.009845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-TestMinimumBasicScenario-175981902 Jul 29 11:53:14.009845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-TestMinimumBasicScenario-175981902-project Jul 29 11:53:14.009845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:53:14.009845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:53:14.009845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 5c56880b1a64449e8e0de42174222600 Jul 29 11:53:14.009845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-TestMinimumBasicScenario-175981902-project Jul 29 11:53:14.009845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:53:14.009845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance f49b2279-4842-4a6c-8dc4-c3429b36f44b could not be found. Jul 29 11:53:14.009845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': 'f49b2279-4842-4a6c-8dc4-c3429b36f44b'} Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f49b2279-4842-4a6c-8dc4-c3429b36f44b could not be found. Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:53:14.011095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f49b2279-4842-4a6c-8dc4-c3429b36f44b could not be found. Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f49b2279-4842-4a6c-8dc4-c3429b36f44b could not be found. Jul 29 11:53:14.012296 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:14.013372 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9c8b8559-1077-43a1-8d2b-d958ea9ab598 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Returning 404 to user: Instance f49b2279-4842-4a6c-8dc4-c3429b36f44b could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:53:14.013372 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-9c8b8559-1077-43a1-8d2b-d958ea9ab598 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b" status: 404 len: 111 microversion: 2.1 time: 0.037160 Jul 29 11:53:14.013372 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 388/762] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:13 2022] GET /compute/v2.1/servers/f49b2279-4842-4a6c-8dc4-c3429b36f44b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:53:14.018241 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-87dbc9b4-f199-41e0-b420-9e4053a150b7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] Calling method '.version_select at 0x7f68f9ec9670>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:14.037402 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-87dbc9b4-f199-41e0-b420-9e4053a150b7 tempest-TestMinimumBasicScenario-175981902 tempest-TestMinimumBasicScenario-175981902-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-263033650" status: 202 len: 0 microversion: 2.1 time: 0.022596 Jul 29 11:53:14.038057 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 375/763] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Jul 29 11:53:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-263033650 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:53:14.056757 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ec1c795a-a7ea-4724-81b3-b8aa912acde2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:14.057391 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ec1c795a-a7ea-4724-81b3-b8aa912acde2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:14.064472 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ec1c795a-a7ea-4724-81b3-b8aa912acde2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:14.064949 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ec1c795a-a7ea-4724-81b3-b8aa912acde2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:14.066284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ec1c795a-a7ea-4724-81b3-b8aa912acde2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:14.066284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ec1c795a-a7ea-4724-81b3-b8aa912acde2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:14.081106 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-ec1c795a-a7ea-4724-81b3-b8aa912acde2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] HTTP exception thrown: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ec1c795a-a7ea-4724-81b3-b8aa912acde2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Request method failure captured: Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b HTTP/1.1 Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48iWtquXP-sIy6Pg2mXeCJeu8cOd9bTOMo_weOHlmXUJ7k8ytjjywePILXvm8gLQczQzuxDILJ_wMX-profRnhSAwhNVjXD0V-zZxJ_bMDnSGsdfJT1vG9FfZR43Uav5QY7b6H9T_08WsKwZjwPSV6s-rVGQdZ5MisBIwUeEnKsW5BI Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 90047b9130334326ad98280a8edb2bc6 Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:53:14.083413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:53:14.084968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_90047b9130334326ad98280a8edb2bc6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:53:14.084968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:53:14.084968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 90047b9130334326ad98280a8edb2bc6 Jul 29 11:53:14.084968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:53:14.084968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-AttachVolumeShelveTestJSON-49761931-project Jul 29 11:53:14.084968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:53:14.084968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:53:14.084968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: ee3506015d9240258cbada860704dffe Jul 29 11:53:14.084968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49761931-project Jul 29 11:53:14.084968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:53:14.084968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. Jul 29 11:53:14.084968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '21b28697-8f3b-4087-ae1b-836eb376d11b'} Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:53:14.090011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. Jul 29 11:53:14.092616 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:14.094345 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ec1c795a-a7ea-4724-81b3-b8aa912acde2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Returning 404 to user: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:53:14.094345 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ec1c795a-a7ea-4724-81b3-b8aa912acde2 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 404 len: 111 microversion: 2.20 time: 0.033245 Jul 29 11:53:14.094345 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 389/764] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:53:14 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 29 11:53:14.094961 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9b6b02da-b50a-45c4-a455-ccac8214ac66 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '.version_select at 0x7f68f9e58ee0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:14.116546 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9b6b02da-b50a-45c4-a455-ccac8214ac66 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101844042" status: 204 len: 0 microversion: 2.20 time: 0.025358 Jul 29 11:53:14.117388 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 376/765] 10.222.0.60 () {60 vars in 1262 bytes} [Fri Jul 29 11:53:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101844042 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 11:53:15.967412 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-aa1f34dd-0201-4def-ba67-4bf3029cdfe8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:15.968546 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-aa1f34dd-0201-4def-ba67-4bf3029cdfe8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:15.976362 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aa1f34dd-0201-4def-ba67-4bf3029cdfe8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:15.976927 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aa1f34dd-0201-4def-ba67-4bf3029cdfe8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:15.977902 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aa1f34dd-0201-4def-ba67-4bf3029cdfe8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:15.978421 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aa1f34dd-0201-4def-ba67-4bf3029cdfe8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:15.994557 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-aa1f34dd-0201-4def-ba67-4bf3029cdfe8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] HTTP exception thrown: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-aa1f34dd-0201-4def-ba67-4bf3029cdfe8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Request method failure captured: Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: DELETE /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b HTTP/1.1 Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48iWtquXP-sIy6Pg2mXeCJeu8cOd9bTOMo_weOHlmXUJ7k8ytjjywePILXvm8gLQczQzuxDILJ_wMX-profRnhSAwhNVjXD0V-zZxJ_bMDnSGsdfJT1vG9FfZR43Uav5QY7b6H9T_08WsKwZjwPSV6s-rVGQdZ5MisBIwUeEnKsW5BI Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 90047b9130334326ad98280a8edb2bc6 Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:53:15.996192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:53:15.997643 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_90047b9130334326ad98280a8edb2bc6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:53:15.997643 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:53:15.997643 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 90047b9130334326ad98280a8edb2bc6 Jul 29 11:53:15.997643 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:53:15.997643 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-AttachVolumeShelveTestJSON-49761931-project Jul 29 11:53:15.997643 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:53:15.997643 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:53:15.997643 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: ee3506015d9240258cbada860704dffe Jul 29 11:53:15.997643 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49761931-project Jul 29 11:53:15.997643 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:53:15.997643 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. Jul 29 11:53:15.997643 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '21b28697-8f3b-4087-ae1b-836eb376d11b'} Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:53:15.998415 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. Jul 29 11:53:15.999610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:16.000817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-aa1f34dd-0201-4def-ba67-4bf3029cdfe8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Returning 404 to user: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:53:16.000817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-aa1f34dd-0201-4def-ba67-4bf3029cdfe8 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "DELETE /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 404 len: 111 microversion: 2.20 time: 0.034535 Jul 29 11:53:16.000817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 390/766] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Jul 29 11:53:15 2022] DELETE /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 11:53:16.007803 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-d0ec6a84-9598-489b-8e3a-ddc2a88aef34 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:16.008428 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-d0ec6a84-9598-489b-8e3a-ddc2a88aef34 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: 21b28697-8f3b-4087-ae1b-836eb376d11b] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:16.010998 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:16.016526 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d0ec6a84-9598-489b-8e3a-ddc2a88aef34 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:16.016977 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d0ec6a84-9598-489b-8e3a-ddc2a88aef34 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:16.017787 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d0ec6a84-9598-489b-8e3a-ddc2a88aef34 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:16.018233 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d0ec6a84-9598-489b-8e3a-ddc2a88aef34 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:16.034193 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-d0ec6a84-9598-489b-8e3a-ddc2a88aef34 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] HTTP exception thrown: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-d0ec6a84-9598-489b-8e3a-ddc2a88aef34 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Request method failure captured: Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b HTTP/1.1 Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48iWtquXP-sIy6Pg2mXeCJeu8cOd9bTOMo_weOHlmXUJ7k8ytjjywePILXvm8gLQczQzuxDILJ_wMX-profRnhSAwhNVjXD0V-zZxJ_bMDnSGsdfJT1vG9FfZR43Uav5QY7b6H9T_08WsKwZjwPSV6s-rVGQdZ5MisBIwUeEnKsW5BI Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 90047b9130334326ad98280a8edb2bc6 Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:53:16.035981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:53:16.037366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_90047b9130334326ad98280a8edb2bc6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:53:16.037366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:53:16.037366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 90047b9130334326ad98280a8edb2bc6 Jul 29 11:53:16.037366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:53:16.037366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-AttachVolumeShelveTestJSON-49761931-project Jul 29 11:53:16.037366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:53:16.037366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:53:16.037366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: ee3506015d9240258cbada860704dffe Jul 29 11:53:16.037366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49761931-project Jul 29 11:53:16.037366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:53:16.037366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. Jul 29 11:53:16.037366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': '21b28697-8f3b-4087-ae1b-836eb376d11b'} Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:53:16.038118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. Jul 29 11:53:16.039307 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:16.040408 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-d0ec6a84-9598-489b-8e3a-ddc2a88aef34 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Returning 404 to user: Instance 21b28697-8f3b-4087-ae1b-836eb376d11b could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:53:16.040408 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-d0ec6a84-9598-489b-8e3a-ddc2a88aef34 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b" status: 404 len: 111 microversion: 2.20 time: 0.034749 Jul 29 11:53:16.040408 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 377/767] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:53:16 2022] GET /compute/v2.1/servers/21b28697-8f3b-4087-ae1b-836eb376d11b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 11:53:17.209647 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3a871568-d3b6-4a90-aa57-c95f57eacf0f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:17.210545 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3a871568-d3b6-4a90-aa57-c95f57eacf0f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:17.217000 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3a871568-d3b6-4a90-aa57-c95f57eacf0f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:17.217495 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3a871568-d3b6-4a90-aa57-c95f57eacf0f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:17.218270 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3a871568-d3b6-4a90-aa57-c95f57eacf0f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:17.218712 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3a871568-d3b6-4a90-aa57-c95f57eacf0f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:17.232311 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-3a871568-d3b6-4a90-aa57-c95f57eacf0f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] HTTP exception thrown: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3a871568-d3b6-4a90-aa57-c95f57eacf0f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Request method failure captured: Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: DELETE /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 HTTP/1.1 Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48iWtquXP-sIy6Pg2mXeCJeu8cOd9bTOMo_weOHlmXUJ7k8ytjjywePILXvm8gLQczQzuxDILJ_wMX-profRnhSAwhNVjXD0V-zZxJ_bMDnSGsdfJT1vG9FfZR43Uav5QY7b6H9T_08WsKwZjwPSV6s-rVGQdZ5MisBIwUeEnKsW5BI Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 90047b9130334326ad98280a8edb2bc6 Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:53:17.233896 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:53:17.235365 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_90047b9130334326ad98280a8edb2bc6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:53:17.235365 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:53:17.235365 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 90047b9130334326ad98280a8edb2bc6 Jul 29 11:53:17.235365 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:53:17.235365 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-AttachVolumeShelveTestJSON-49761931-project Jul 29 11:53:17.235365 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:53:17.235365 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:53:17.235365 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: ee3506015d9240258cbada860704dffe Jul 29 11:53:17.235365 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49761931-project Jul 29 11:53:17.235365 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:53:17.235365 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. Jul 29 11:53:17.235365 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': 'd7bd0b02-2726-4432-a6a1-53035c9a1978'} Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:53:17.236399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. Jul 29 11:53:17.238337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:53:17.240331 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3a871568-d3b6-4a90-aa57-c95f57eacf0f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Returning 404 to user: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:53:17.240331 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3a871568-d3b6-4a90-aa57-c95f57eacf0f tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 404 len: 111 microversion: 2.20 time: 0.030188 Jul 29 11:53:17.240331 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 391/768] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Jul 29 11:53:17 2022] DELETE /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 11:53:17.246125 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-1d5dbf29-0e35-47b7-ab7f-006e570fe319 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:17.246757 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-1d5dbf29-0e35-47b7-ab7f-006e570fe319 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] [instance: d7bd0b02-2726-4432-a6a1-53035c9a1978] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:17.253507 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1d5dbf29-0e35-47b7-ab7f-006e570fe319 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:17.253972 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1d5dbf29-0e35-47b7-ab7f-006e570fe319 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:17.254761 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1d5dbf29-0e35-47b7-ab7f-006e570fe319 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:17.255208 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1d5dbf29-0e35-47b7-ab7f-006e570fe319 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:17.269725 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-1d5dbf29-0e35-47b7-ab7f-006e570fe319 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] HTTP exception thrown: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-1d5dbf29-0e35-47b7-ab7f-006e570fe319 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Request method failure captured: Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 HTTP/1.1 Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48iWtquXP-sIy6Pg2mXeCJeu8cOd9bTOMo_weOHlmXUJ7k8ytjjywePILXvm8gLQczQzuxDILJ_wMX-profRnhSAwhNVjXD0V-zZxJ_bMDnSGsdfJT1vG9FfZR43Uav5QY7b6H9T_08WsKwZjwPSV6s-rVGQdZ5MisBIwUeEnKsW5BI Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 90047b9130334326ad98280a8edb2bc6 Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:53:17.271836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:53:17.273492 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_90047b9130334326ad98280a8edb2bc6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/90047b9130334326ad98280a8edb2bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:53:17.273492 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:53:17.273492 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 90047b9130334326ad98280a8edb2bc6 Jul 29 11:53:17.273492 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49761931 Jul 29 11:53:17.273492 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-AttachVolumeShelveTestJSON-49761931-project Jul 29 11:53:17.273492 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:53:17.273492 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:53:17.273492 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: ee3506015d9240258cbada860704dffe Jul 29 11:53:17.273492 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49761931-project Jul 29 11:53:17.273492 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:53:17.273492 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. Jul 29 11:53:17.273492 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': 'd7bd0b02-2726-4432-a6a1-53035c9a1978'} Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:53:17.274739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. Jul 29 11:53:17.275991 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:53:17.277689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-1d5dbf29-0e35-47b7-ab7f-006e570fe319 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] Returning 404 to user: Instance d7bd0b02-2726-4432-a6a1-53035c9a1978 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:53:17.277689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-1d5dbf29-0e35-47b7-ab7f-006e570fe319 tempest-AttachVolumeShelveTestJSON-49761931 tempest-AttachVolumeShelveTestJSON-49761931-project] 10.222.0.60 "GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978" status: 404 len: 111 microversion: 2.20 time: 0.031347 Jul 29 11:53:17.277689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 378/769] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Jul 29 11:53:17 2022] GET /compute/v2.1/servers/d7bd0b02-2726-4432-a6a1-53035c9a1978 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 11:53:30.614811 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=7 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:30.615827 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=26 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:30.953710 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-facf2d82-33c7-456f-80a9-72e569cefef4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Action: 'create', calling method: .version_select at 0x7f68f9f47f70>, body: {"keypair": {"name": "tempest-keypair-300045849", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMk0Nv5zoiMHrKwiVfew+2cH5HTC1YKwLOyq/Q7jW2YnXR4s6wjtXGYjJ0SRG1ujBUpkletrP+feRuM9gy4O4npdnSxxsOaZ7aDrogiBnuSYF7wvuSe+hF74EQvDhiTwag=="}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:53:30.979669 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-facf2d82-33c7-456f-80a9-72e569cefef4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Getting quotas for project 69ac15e2b1074938adfa7615f1ff1495. Resources: {'key_pairs'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:53:30.984294 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-facf2d82-33c7-456f-80a9-72e569cefef4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Getting quotas for user 20da01b3f86d40cfa84762492eea43f1 and project 69ac15e2b1074938adfa7615f1ff1495. Resources: {'key_pairs'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:53:31.012350 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-facf2d82-33c7-456f-80a9-72e569cefef4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.405311 Jul 29 11:53:31.013241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 392/770] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Jul 29 11:53:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:53:32.869531 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4e1d3c75-5658-4e84-8631-edd48e227f05 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-136423358", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6a7e919-a436-4946-8b78-7a1d701f617b"}], "security_groups": [{"name": "tempest-securitygroup--1853661550"}], "key_name": "tempest-keypair-300045849", "user_data": "}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:53:32.879634 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=3 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:32.880520 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=30 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:33.023462 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.network.neutron [None req-4e1d3c75-5658-4e84-8631-edd48e227f05 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] validate_networks() for [('b6a7e919-a436-4946-8b78-7a1d701f617b', None, None, None, None, None)] {{(pid=129585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:53:33.701977 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-4e1d3c75-5658-4e84-8631-edd48e227f05 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Flavor limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:53:33.702409 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-4e1d3c75-5658-4e84-8631-edd48e227f05 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Image limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:53:33.702885 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-4e1d3c75-5658-4e84-8631-edd48e227f05 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Flavor pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:53:33.703292 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-4e1d3c75-5658-4e84-8631-edd48e227f05 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Image pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:53:33.703707 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-4e1d3c75-5658-4e84-8631-edd48e227f05 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:53:33.718637 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4e1d3c75-5658-4e84-8631-edd48e227f05 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:33.719419 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4e1d3c75-5658-4e84-8631-edd48e227f05 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:33.720895 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4e1d3c75-5658-4e84-8631-edd48e227f05 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:33.721612 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4e1d3c75-5658-4e84-8631-edd48e227f05 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:33.756110 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-4e1d3c75-5658-4e84-8631-edd48e227f05 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Getting quotas for project 69ac15e2b1074938adfa7615f1ff1495. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:53:33.761806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-4e1d3c75-5658-4e84-8631-edd48e227f05 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Getting quotas for user 20da01b3f86d40cfa84762492eea43f1 and project 69ac15e2b1074938adfa7615f1ff1495. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:53:33.776154 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4e1d3c75-5658-4e84-8631-edd48e227f05 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Going to run 1 instances... {{(pid=129585) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:53:33.779313 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4e1d3c75-5658-4e84-8631-edd48e227f05 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:53:33.872734 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4e1d3c75-5658-4e84-8631-edd48e227f05 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.009612 Jul 29 11:53:33.874881 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 379/771] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:53:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 11:53:33.888410 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-32d46232-ec44-4ce1-a106-80358351e233 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:33.889164 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-32d46232-ec44-4ce1-a106-80358351e233 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:33.980124 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-32d46232-ec44-4ce1-a106-80358351e233 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:33.992484 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-32d46232-ec44-4ce1-a106-80358351e233 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1236 microversion: 2.1 time: 0.108352 Jul 29 11:53:33.993183 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 393/772] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:33 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1236 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:35.015220 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-368b8d00-9fb9-4fa8-82a7-59e73d0df7f8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:35.015999 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-368b8d00-9fb9-4fa8-82a7-59e73d0df7f8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:35.031708 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-368b8d00-9fb9-4fa8-82a7-59e73d0df7f8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:35.032222 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-368b8d00-9fb9-4fa8-82a7-59e73d0df7f8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:35.033048 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-368b8d00-9fb9-4fa8-82a7-59e73d0df7f8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:35.033531 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-368b8d00-9fb9-4fa8-82a7-59e73d0df7f8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:35.198269 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-368b8d00-9fb9-4fa8-82a7-59e73d0df7f8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:35.207482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-368b8d00-9fb9-4fa8-82a7-59e73d0df7f8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1240 microversion: 2.1 time: 0.198215 Jul 29 11:53:35.209224 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 380/773] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:35 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1240 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:36.229906 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-46d1f39f-41b3-47d4-acae-4c719a4bfa69 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:36.231269 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-46d1f39f-41b3-47d4-acae-4c719a4bfa69 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:36.239152 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-46d1f39f-41b3-47d4-acae-4c719a4bfa69 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:36.239592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-46d1f39f-41b3-47d4-acae-4c719a4bfa69 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:36.240504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-46d1f39f-41b3-47d4-acae-4c719a4bfa69 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:36.240981 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-46d1f39f-41b3-47d4-acae-4c719a4bfa69 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:36.359936 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-46d1f39f-41b3-47d4-acae-4c719a4bfa69 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:36.386527 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-46d1f39f-41b3-47d4-acae-4c719a4bfa69 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1296 microversion: 2.1 time: 0.160794 Jul 29 11:53:36.387217 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 394/774] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:36 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1296 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:37.408459 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-682065fd-7759-451d-83e8-54ea3f8c037a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:37.408924 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-682065fd-7759-451d-83e8-54ea3f8c037a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:37.418367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-682065fd-7759-451d-83e8-54ea3f8c037a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:37.418840 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-682065fd-7759-451d-83e8-54ea3f8c037a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:37.426330 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-682065fd-7759-451d-83e8-54ea3f8c037a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:37.426837 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-682065fd-7759-451d-83e8-54ea3f8c037a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:37.707370 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-682065fd-7759-451d-83e8-54ea3f8c037a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:37.719576 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-682065fd-7759-451d-83e8-54ea3f8c037a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1362 microversion: 2.1 time: 0.315180 Jul 29 11:53:37.720167 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 381/775] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:37 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:38.571918 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-aa31e8ea-62f3-49de-ae6e-c21f1e63309e req-ca112c81-107e-4b4a-bcc0-9f11ac8ffc93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55552e03-f570-4ef7-b624-83ed029e89a9", "tag": "410dad97-edfe-4c3c-b0a9-ccea29876b7a"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:53:38.608287 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-aa31e8ea-62f3-49de-ae6e-c21f1e63309e req-ca112c81-107e-4b4a-bcc0-9f11ac8ffc93 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:38.609358 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-aa31e8ea-62f3-49de-ae6e-c21f1e63309e req-ca112c81-107e-4b4a-bcc0-9f11ac8ffc93 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:38.630907 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-aa31e8ea-62f3-49de-ae6e-c21f1e63309e req-ca112c81-107e-4b4a-bcc0-9f11ac8ffc93 service nova] Creating event network-changed:410dad97-edfe-4c3c-b0a9-ccea29876b7a for instance 55552e03-f570-4ef7-b624-83ed029e89a9 on hv-cinder-83754 Jul 29 11:53:38.644834 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-aa31e8ea-62f3-49de-ae6e-c21f1e63309e req-ca112c81-107e-4b4a-bcc0-9f11ac8ffc93 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078301 Jul 29 11:53:38.646144 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 395/776] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:53:38.743756 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4676b0d8-542d-4053-b4df-7c1e635942e6 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:38.745583 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4676b0d8-542d-4053-b4df-7c1e635942e6 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:38.779927 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4676b0d8-542d-4053-b4df-7c1e635942e6 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:38.780403 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4676b0d8-542d-4053-b4df-7c1e635942e6 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:38.781214 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4676b0d8-542d-4053-b4df-7c1e635942e6 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:38.786210 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4676b0d8-542d-4053-b4df-7c1e635942e6 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:39.206727 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-4676b0d8-542d-4053-b4df-7c1e635942e6 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:39.235331 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4676b0d8-542d-4053-b4df-7c1e635942e6 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1362 microversion: 2.1 time: 0.498332 Jul 29 11:53:39.236016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 382/777] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:38 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1362 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:39.642515 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b95acdd4-82cb-4119-8f02-f13b854a03d6 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Action: 'create', calling method: .version_select at 0x7f68f9ee7e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1457815757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdmIzHyEWIhWn2TFaC6JlY5gAzqv0rMuZWNC96i/oFbNP2dtJDKtJOlI2ANqLVy4WkyiSkbp/om4TXZZJjzTTAGB3QmnmBVY4ohk+eobvOCjUsZzE24S83UHlgQzhyuhQ=="}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:53:39.658337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-b95acdd4-82cb-4119-8f02-f13b854a03d6 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Getting quotas for project 8fd8c34715e54a778911a8410e095800. Resources: {'key_pairs'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:53:39.662540 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-b95acdd4-82cb-4119-8f02-f13b854a03d6 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Getting quotas for user 2a98ee7a5076425aa7cf6cb2107da67f and project 8fd8c34715e54a778911a8410e095800. Resources: {'key_pairs'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:53:39.688511 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b95acdd4-82cb-4119-8f02-f13b854a03d6 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.219668 Jul 29 11:53:39.689116 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 396/778] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Jul 29 11:53:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:53:40.258639 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-0d2da771-0f16-4264-9075-b973b99096c4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:40.259263 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-0d2da771-0f16-4264-9075-b973b99096c4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:40.266073 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0d2da771-0f16-4264-9075-b973b99096c4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:40.266529 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0d2da771-0f16-4264-9075-b973b99096c4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:40.267290 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0d2da771-0f16-4264-9075-b973b99096c4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:40.267726 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0d2da771-0f16-4264-9075-b973b99096c4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:40.407458 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-0d2da771-0f16-4264-9075-b973b99096c4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:40.416489 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-0d2da771-0f16-4264-9075-b973b99096c4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1362 microversion: 2.1 time: 0.162965 Jul 29 11:53:40.417075 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 383/779] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:40 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:41.440367 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c1709cad-3fb2-470e-93c4-f0f5215e0f99 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:41.441191 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c1709cad-3fb2-470e-93c4-f0f5215e0f99 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:41.450303 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c1709cad-3fb2-470e-93c4-f0f5215e0f99 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:41.450991 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c1709cad-3fb2-470e-93c4-f0f5215e0f99 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:41.451982 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c1709cad-3fb2-470e-93c4-f0f5215e0f99 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:41.452621 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c1709cad-3fb2-470e-93c4-f0f5215e0f99 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:41.624863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c1709cad-3fb2-470e-93c4-f0f5215e0f99 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:41.633913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c1709cad-3fb2-470e-93c4-f0f5215e0f99 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1362 microversion: 2.1 time: 0.200542 Jul 29 11:53:41.634730 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 397/780] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:41 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:42.655482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-03a795c8-5f1c-4ffb-953b-e15dd6e5ca41 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:42.656755 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-03a795c8-5f1c-4ffb-953b-e15dd6e5ca41 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:42.663671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-03a795c8-5f1c-4ffb-953b-e15dd6e5ca41 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:42.664122 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-03a795c8-5f1c-4ffb-953b-e15dd6e5ca41 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:42.664900 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-03a795c8-5f1c-4ffb-953b-e15dd6e5ca41 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:42.665347 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-03a795c8-5f1c-4ffb-953b-e15dd6e5ca41 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:42.811714 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-03a795c8-5f1c-4ffb-953b-e15dd6e5ca41 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:42.822414 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-03a795c8-5f1c-4ffb-953b-e15dd6e5ca41 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1362 microversion: 2.1 time: 0.171021 Jul 29 11:53:42.823066 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 384/781] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:42 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:43.845935 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ee12b546-9570-4df6-a17a-6d49d9916754 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:43.847495 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ee12b546-9570-4df6-a17a-6d49d9916754 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:43.857588 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ee12b546-9570-4df6-a17a-6d49d9916754 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:43.858050 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ee12b546-9570-4df6-a17a-6d49d9916754 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:43.859391 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ee12b546-9570-4df6-a17a-6d49d9916754 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:43.859837 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ee12b546-9570-4df6-a17a-6d49d9916754 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:43.997009 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ee12b546-9570-4df6-a17a-6d49d9916754 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:44.007944 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ee12b546-9570-4df6-a17a-6d49d9916754 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1362 microversion: 2.1 time: 0.167222 Jul 29 11:53:44.009754 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 398/782] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:43 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:45.030344 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5521ec9a-73a3-42e6-bd3c-696d7f02a0c8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:45.030862 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-5521ec9a-73a3-42e6-bd3c-696d7f02a0c8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:45.033490 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:45.034303 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=6 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:45.041524 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5521ec9a-73a3-42e6-bd3c-696d7f02a0c8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:45.041984 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5521ec9a-73a3-42e6-bd3c-696d7f02a0c8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:45.042782 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5521ec9a-73a3-42e6-bd3c-696d7f02a0c8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:45.043219 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5521ec9a-73a3-42e6-bd3c-696d7f02a0c8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:45.183577 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-5521ec9a-73a3-42e6-bd3c-696d7f02a0c8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:45.194358 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-5521ec9a-73a3-42e6-bd3c-696d7f02a0c8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1362 microversion: 2.1 time: 0.167396 Jul 29 11:53:45.194472 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 385/783] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:45 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:46.214670 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-98c215ed-aa19-49fb-8810-df2af1fe8019 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:46.215305 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-98c215ed-aa19-49fb-8810-df2af1fe8019 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:46.221973 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-98c215ed-aa19-49fb-8810-df2af1fe8019 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:46.222417 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-98c215ed-aa19-49fb-8810-df2af1fe8019 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:46.223195 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-98c215ed-aa19-49fb-8810-df2af1fe8019 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:46.223634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-98c215ed-aa19-49fb-8810-df2af1fe8019 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:46.366041 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-98c215ed-aa19-49fb-8810-df2af1fe8019 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:46.374685 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-98c215ed-aa19-49fb-8810-df2af1fe8019 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1362 microversion: 2.1 time: 0.163750 Jul 29 11:53:46.375450 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 399/784] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:46 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:47.396584 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-992498e2-3474-4949-8e35-825eb10b6ee9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:47.397210 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-992498e2-3474-4949-8e35-825eb10b6ee9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:47.404368 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-992498e2-3474-4949-8e35-825eb10b6ee9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:47.404891 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-992498e2-3474-4949-8e35-825eb10b6ee9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:47.405788 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-992498e2-3474-4949-8e35-825eb10b6ee9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:47.406290 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-992498e2-3474-4949-8e35-825eb10b6ee9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:47.547327 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-992498e2-3474-4949-8e35-825eb10b6ee9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:47.555464 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-992498e2-3474-4949-8e35-825eb10b6ee9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1362 microversion: 2.1 time: 0.163373 Jul 29 11:53:47.556127 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 386/785] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:47 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:48.100414 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-b1ae5dff-72f8-48e8-8d0b-3dd9ec899145 req-ef368e99-bae0-447d-914b-bd125fd3ae3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55552e03-f570-4ef7-b624-83ed029e89a9", "name": "network-vif-plugged", "status": "completed", "tag": "410dad97-edfe-4c3c-b0a9-ccea29876b7a"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:53:48.111179 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-b1ae5dff-72f8-48e8-8d0b-3dd9ec899145 req-ef368e99-bae0-447d-914b-bd125fd3ae3e service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:48.111624 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-b1ae5dff-72f8-48e8-8d0b-3dd9ec899145 req-ef368e99-bae0-447d-914b-bd125fd3ae3e service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:48.122749 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-b1ae5dff-72f8-48e8-8d0b-3dd9ec899145 req-ef368e99-bae0-447d-914b-bd125fd3ae3e service nova] Creating event network-vif-plugged:410dad97-edfe-4c3c-b0a9-ccea29876b7a for instance 55552e03-f570-4ef7-b624-83ed029e89a9 on hv-cinder-83754 Jul 29 11:53:48.127589 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-b1ae5dff-72f8-48e8-8d0b-3dd9ec899145 req-ef368e99-bae0-447d-914b-bd125fd3ae3e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037267 Jul 29 11:53:48.128171 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 400/786] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:53:48.576112 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-82ce0a61-708e-4a49-8368-8d40224b72a8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:48.576716 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-82ce0a61-708e-4a49-8368-8d40224b72a8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:48.583698 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-82ce0a61-708e-4a49-8368-8d40224b72a8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:48.584142 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-82ce0a61-708e-4a49-8368-8d40224b72a8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:48.584897 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-82ce0a61-708e-4a49-8368-8d40224b72a8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:48.585328 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-82ce0a61-708e-4a49-8368-8d40224b72a8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:48.728232 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-82ce0a61-708e-4a49-8368-8d40224b72a8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:48.737561 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-82ce0a61-708e-4a49-8368-8d40224b72a8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1362 microversion: 2.1 time: 0.165165 Jul 29 11:53:48.738129 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 387/787] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:48 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:49.757363 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=10 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:53:49.763423 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-84df6679-2e0b-4781-86fa-9f4da425f9b6 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:49.764437 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-84df6679-2e0b-4781-86fa-9f4da425f9b6 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:49.772320 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-84df6679-2e0b-4781-86fa-9f4da425f9b6 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:49.772777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-84df6679-2e0b-4781-86fa-9f4da425f9b6 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:49.773773 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-84df6679-2e0b-4781-86fa-9f4da425f9b6 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:49.774219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-84df6679-2e0b-4781-86fa-9f4da425f9b6 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:49.921704 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-84df6679-2e0b-4781-86fa-9f4da425f9b6 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:49.931774 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-84df6679-2e0b-4781-86fa-9f4da425f9b6 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1362 microversion: 2.1 time: 0.175948 Jul 29 11:53:49.942986 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 401/788] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:49 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:50.965394 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-52269dee-3cb2-4002-8a06-75563a10d6a9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:50.965989 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-52269dee-3cb2-4002-8a06-75563a10d6a9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:50.972652 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-52269dee-3cb2-4002-8a06-75563a10d6a9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:50.973177 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-52269dee-3cb2-4002-8a06-75563a10d6a9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:50.973992 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-52269dee-3cb2-4002-8a06-75563a10d6a9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:50.974437 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-52269dee-3cb2-4002-8a06-75563a10d6a9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:51.116311 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-52269dee-3cb2-4002-8a06-75563a10d6a9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:53:51.123759 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-52269dee-3cb2-4002-8a06-75563a10d6a9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1548 microversion: 2.1 time: 0.162280 Jul 29 11:53:51.124322 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 388/789] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:53:50 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:53:51.149720 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e7cfd86b-1a94-4c30-888c-32128fdd45c2 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:53:51.150338 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e7cfd86b-1a94-4c30-888c-32128fdd45c2 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:53:51.156516 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e7cfd86b-1a94-4c30-888c-32128fdd45c2 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:51.156974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e7cfd86b-1a94-4c30-888c-32128fdd45c2 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:51.157760 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e7cfd86b-1a94-4c30-888c-32128fdd45c2 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:51.158200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e7cfd86b-1a94-4c30-888c-32128fdd45c2 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:51.247338 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e7cfd86b-1a94-4c30-888c-32128fdd45c2 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102440 Jul 29 11:53:51.249485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 402/790] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Jul 29 11:53:51 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:53:52.530198 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-df120f8f-d708-492f-9548-bb6a5c8ff0b3 req-99a7ef68-9412-486c-b3ce-ee9a5eeaf569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55552e03-f570-4ef7-b624-83ed029e89a9", "tag": "410dad97-edfe-4c3c-b0a9-ccea29876b7a"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:53:52.544716 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-df120f8f-d708-492f-9548-bb6a5c8ff0b3 req-99a7ef68-9412-486c-b3ce-ee9a5eeaf569 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:53:52.545074 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-df120f8f-d708-492f-9548-bb6a5c8ff0b3 req-99a7ef68-9412-486c-b3ce-ee9a5eeaf569 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:53:52.556968 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-df120f8f-d708-492f-9548-bb6a5c8ff0b3 req-99a7ef68-9412-486c-b3ce-ee9a5eeaf569 service nova] Creating event network-changed:410dad97-edfe-4c3c-b0a9-ccea29876b7a for instance 55552e03-f570-4ef7-b624-83ed029e89a9 on hv-cinder-83754 Jul 29 11:53:52.562046 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-df120f8f-d708-492f-9548-bb6a5c8ff0b3 req-99a7ef68-9412-486c-b3ce-ee9a5eeaf569 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035557 Jul 29 11:53:52.562647 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 389/791] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:53:59.747879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e68a2a8a-4c2b-496f-b16a-92dffe4dc4b3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-624930466", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1457815757", "security_groups": [{"name": "tempest-secgroup-smoke-289239366"}], "networks": [{"uuid": "e1635cb4-4518-4798-bf38-f145b18a5f1f"}], "block_device_mapping_v2": [{"uuid": "98bd62b0-fe48-4b41-bba9-ba7ed8d8217e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:53:59.858077 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.network.neutron [None req-e68a2a8a-4c2b-496f-b16a-92dffe4dc4b3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] validate_networks() for [('e1635cb4-4518-4798-bf38-f145b18a5f1f', None, None, None, None, None)] {{(pid=129584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:54:00.323192 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-e68a2a8a-4c2b-496f-b16a-92dffe4dc4b3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Flavor limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:54:00.323635 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-e68a2a8a-4c2b-496f-b16a-92dffe4dc4b3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Image limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:54:00.324114 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-e68a2a8a-4c2b-496f-b16a-92dffe4dc4b3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Flavor pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:54:00.324528 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-e68a2a8a-4c2b-496f-b16a-92dffe4dc4b3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Image pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:54:00.324946 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-e68a2a8a-4c2b-496f-b16a-92dffe4dc4b3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:54:00.333871 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e68a2a8a-4c2b-496f-b16a-92dffe4dc4b3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:00.334323 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e68a2a8a-4c2b-496f-b16a-92dffe4dc4b3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:00.335126 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e68a2a8a-4c2b-496f-b16a-92dffe4dc4b3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:00.335561 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e68a2a8a-4c2b-496f-b16a-92dffe4dc4b3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:00.352983 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-e68a2a8a-4c2b-496f-b16a-92dffe4dc4b3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Getting quotas for project 8fd8c34715e54a778911a8410e095800. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:54:00.356952 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-e68a2a8a-4c2b-496f-b16a-92dffe4dc4b3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Getting quotas for user 2a98ee7a5076425aa7cf6cb2107da67f and project 8fd8c34715e54a778911a8410e095800. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:54:00.415668 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e68a2a8a-4c2b-496f-b16a-92dffe4dc4b3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Going to run 1 instances... {{(pid=129584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:54:00.417823 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e68a2a8a-4c2b-496f-b16a-92dffe4dc4b3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98bd62b0-fe48-4b41-bba9-ba7ed8d8217e',volume_size=None,volume_type=None)] {{(pid=129584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:54:00.553260 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e68a2a8a-4c2b-496f-b16a-92dffe4dc4b3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.809743 Jul 29 11:54:00.554295 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 403/792] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:53:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 11:54:00.566694 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-1ee23155-517a-43a8-b506-13fa4d1f357d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:00.580238 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-1ee23155-517a-43a8-b506-13fa4d1f357d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:00.639587 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-1ee23155-517a-43a8-b506-13fa4d1f357d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:00.647568 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-1ee23155-517a-43a8-b506-13fa4d1f357d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1088 microversion: 2.1 time: 0.085838 Jul 29 11:54:00.648142 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 390/793] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:00 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1088 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:01.679126 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-aff292bb-218a-4c39-ae40-6e06705b406a tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:01.680590 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-aff292bb-218a-4c39-ae40-6e06705b406a tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:01.685813 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=5 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:01.692552 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aff292bb-218a-4c39-ae40-6e06705b406a tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:01.693008 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aff292bb-218a-4c39-ae40-6e06705b406a tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:01.694240 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aff292bb-218a-4c39-ae40-6e06705b406a tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:01.694608 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aff292bb-218a-4c39-ae40-6e06705b406a tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:01.707288 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=41 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:01.771365 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-aff292bb-218a-4c39-ae40-6e06705b406a tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:01.778827 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-aff292bb-218a-4c39-ae40-6e06705b406a tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1204 microversion: 2.1 time: 0.112614 Jul 29 11:54:01.779398 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 404/794] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:01 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1204 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:02.800916 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-7dcba5bc-ea70-4faa-a2c3-bc8fcc99cc1f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:02.802228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-7dcba5bc-ea70-4faa-a2c3-bc8fcc99cc1f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:02.805696 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=58 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:02.812176 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7dcba5bc-ea70-4faa-a2c3-bc8fcc99cc1f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:02.812716 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7dcba5bc-ea70-4faa-a2c3-bc8fcc99cc1f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:02.813787 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7dcba5bc-ea70-4faa-a2c3-bc8fcc99cc1f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:02.814464 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7dcba5bc-ea70-4faa-a2c3-bc8fcc99cc1f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:02.995710 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-7dcba5bc-ea70-4faa-a2c3-bc8fcc99cc1f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:03.007006 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-7dcba5bc-ea70-4faa-a2c3-bc8fcc99cc1f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1259 microversion: 2.1 time: 0.210284 Jul 29 11:54:03.008306 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 391/795] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:02 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:03.102921 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-b1e5162f-e969-4035-9063-80dff0ba18e3 req-4cdaafd8-48e2-43c2-b43c-61a51c77ec5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ff3352-15b3-4066-b66b-fe3e5c4ff2d6", "tag": "7db84d29-10d0-41a8-abf4-9bb896740271"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:54:03.135434 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-b1e5162f-e969-4035-9063-80dff0ba18e3 req-4cdaafd8-48e2-43c2-b43c-61a51c77ec5d service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:03.136563 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-b1e5162f-e969-4035-9063-80dff0ba18e3 req-4cdaafd8-48e2-43c2-b43c-61a51c77ec5d service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:03.155450 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-b1e5162f-e969-4035-9063-80dff0ba18e3 req-4cdaafd8-48e2-43c2-b43c-61a51c77ec5d service nova] Creating event network-changed:7db84d29-10d0-41a8-abf4-9bb896740271 for instance 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 on hv-cinder-83754 Jul 29 11:54:03.163725 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-b1e5162f-e969-4035-9063-80dff0ba18e3 req-4cdaafd8-48e2-43c2-b43c-61a51c77ec5d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071780 Jul 29 11:54:03.164661 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 405/796] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:54:04.030216 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4f1c1dd7-028b-475c-9a3f-494ae5e29c8f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:04.030887 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4f1c1dd7-028b-475c-9a3f-494ae5e29c8f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:04.033448 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:04.039537 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4f1c1dd7-028b-475c-9a3f-494ae5e29c8f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:04.039950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4f1c1dd7-028b-475c-9a3f-494ae5e29c8f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:04.040723 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4f1c1dd7-028b-475c-9a3f-494ae5e29c8f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:04.041179 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4f1c1dd7-028b-475c-9a3f-494ae5e29c8f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:04.197325 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-4f1c1dd7-028b-475c-9a3f-494ae5e29c8f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:04.204870 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4f1c1dd7-028b-475c-9a3f-494ae5e29c8f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1259 microversion: 2.1 time: 0.179581 Jul 29 11:54:04.205454 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 392/797] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:04 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:05.226598 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e9c62703-5362-43a7-b76c-9a1c02c8b617 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:05.227303 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e9c62703-5362-43a7-b76c-9a1c02c8b617 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:05.234204 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e9c62703-5362-43a7-b76c-9a1c02c8b617 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:05.234659 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e9c62703-5362-43a7-b76c-9a1c02c8b617 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:05.235427 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e9c62703-5362-43a7-b76c-9a1c02c8b617 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:05.235865 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e9c62703-5362-43a7-b76c-9a1c02c8b617 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:05.374248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e9c62703-5362-43a7-b76c-9a1c02c8b617 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:05.382272 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e9c62703-5362-43a7-b76c-9a1c02c8b617 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1259 microversion: 2.1 time: 0.159921 Jul 29 11:54:05.382846 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 406/798] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:05 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:06.403665 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c4a40393-0d22-444a-b918-6aad12189ec1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:06.404375 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-c4a40393-0d22-444a-b918-6aad12189ec1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:06.410903 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c4a40393-0d22-444a-b918-6aad12189ec1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:06.411424 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c4a40393-0d22-444a-b918-6aad12189ec1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:06.412309 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c4a40393-0d22-444a-b918-6aad12189ec1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:06.412756 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c4a40393-0d22-444a-b918-6aad12189ec1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:06.551852 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-c4a40393-0d22-444a-b918-6aad12189ec1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:06.559688 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-c4a40393-0d22-444a-b918-6aad12189ec1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1259 microversion: 2.1 time: 0.159854 Jul 29 11:54:06.560262 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 393/799] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:06 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:07.581268 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-bf7abaf3-47eb-49e7-9825-c7b3961ee3df tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:07.582035 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-bf7abaf3-47eb-49e7-9825-c7b3961ee3df tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:07.588859 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bf7abaf3-47eb-49e7-9825-c7b3961ee3df tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:07.589382 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bf7abaf3-47eb-49e7-9825-c7b3961ee3df tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:07.590183 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bf7abaf3-47eb-49e7-9825-c7b3961ee3df tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:07.590618 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bf7abaf3-47eb-49e7-9825-c7b3961ee3df tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:07.728257 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bf7abaf3-47eb-49e7-9825-c7b3961ee3df tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:07.735832 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-bf7abaf3-47eb-49e7-9825-c7b3961ee3df tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1259 microversion: 2.1 time: 0.158860 Jul 29 11:54:07.736398 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 407/800] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:07 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:08.756911 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-688af26f-345a-4b7f-a28a-f0ce7f51f7ac tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:08.758200 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-688af26f-345a-4b7f-a28a-f0ce7f51f7ac tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:08.766569 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-688af26f-345a-4b7f-a28a-f0ce7f51f7ac tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:08.767256 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-688af26f-345a-4b7f-a28a-f0ce7f51f7ac tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:08.768448 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-688af26f-345a-4b7f-a28a-f0ce7f51f7ac tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:08.769234 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-688af26f-345a-4b7f-a28a-f0ce7f51f7ac tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:08.932048 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-688af26f-345a-4b7f-a28a-f0ce7f51f7ac tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:08.940243 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-688af26f-345a-4b7f-a28a-f0ce7f51f7ac tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1259 microversion: 2.1 time: 0.187881 Jul 29 11:54:08.940831 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 394/801] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:08 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:09.964274 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5ea46407-fabf-465b-95b4-3c405d16c0e7 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:09.964881 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-5ea46407-fabf-465b-95b4-3c405d16c0e7 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:09.971996 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5ea46407-fabf-465b-95b4-3c405d16c0e7 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:09.972443 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5ea46407-fabf-465b-95b4-3c405d16c0e7 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:09.973247 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5ea46407-fabf-465b-95b4-3c405d16c0e7 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:09.974213 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5ea46407-fabf-465b-95b4-3c405d16c0e7 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:10.113302 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5ea46407-fabf-465b-95b4-3c405d16c0e7 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:10.120990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-5ea46407-fabf-465b-95b4-3c405d16c0e7 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1259 microversion: 2.1 time: 0.160555 Jul 29 11:54:10.121594 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 408/802] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:09 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:11.141876 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6d030859-417e-45ac-9df8-a114a1f44dd3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:11.142527 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6d030859-417e-45ac-9df8-a114a1f44dd3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:11.144628 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:11.150851 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6d030859-417e-45ac-9df8-a114a1f44dd3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:11.151366 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6d030859-417e-45ac-9df8-a114a1f44dd3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:11.152279 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6d030859-417e-45ac-9df8-a114a1f44dd3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:11.152858 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6d030859-417e-45ac-9df8-a114a1f44dd3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:11.281683 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6d030859-417e-45ac-9df8-a114a1f44dd3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:11.290143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6d030859-417e-45ac-9df8-a114a1f44dd3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1259 microversion: 2.1 time: 0.152205 Jul 29 11:54:11.290719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 395/803] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:11 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:12.244045 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-164584c3-0c99-40bb-8822-d35370faab97 req-84cc7c50-b5c9-414f-83ba-f3bc787ebd99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ff3352-15b3-4066-b66b-fe3e5c4ff2d6", "name": "network-vif-plugged", "status": "completed", "tag": "7db84d29-10d0-41a8-abf4-9bb896740271"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:54:12.249148 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=2 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:12.249976 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=6 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:12.257702 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-164584c3-0c99-40bb-8822-d35370faab97 req-84cc7c50-b5c9-414f-83ba-f3bc787ebd99 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:12.258151 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-164584c3-0c99-40bb-8822-d35370faab97 req-84cc7c50-b5c9-414f-83ba-f3bc787ebd99 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:12.269470 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-164584c3-0c99-40bb-8822-d35370faab97 req-84cc7c50-b5c9-414f-83ba-f3bc787ebd99 service nova] Creating event network-vif-plugged:7db84d29-10d0-41a8-abf4-9bb896740271 for instance 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 on hv-cinder-83754 Jul 29 11:54:12.274416 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-164584c3-0c99-40bb-8822-d35370faab97 req-84cc7c50-b5c9-414f-83ba-f3bc787ebd99 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034138 Jul 29 11:54:12.275008 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 409/804] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:54:12.310889 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-d231a41e-a54d-45a5-ba64-b38fd14fdf3c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:12.311508 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-d231a41e-a54d-45a5-ba64-b38fd14fdf3c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:12.319052 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d231a41e-a54d-45a5-ba64-b38fd14fdf3c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:12.319509 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d231a41e-a54d-45a5-ba64-b38fd14fdf3c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:12.320286 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d231a41e-a54d-45a5-ba64-b38fd14fdf3c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:12.320723 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-d231a41e-a54d-45a5-ba64-b38fd14fdf3c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:12.462819 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-d231a41e-a54d-45a5-ba64-b38fd14fdf3c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:12.470746 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-d231a41e-a54d-45a5-ba64-b38fd14fdf3c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1259 microversion: 2.1 time: 0.163671 Jul 29 11:54:12.471319 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 396/805] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:12 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:13.492188 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3304e0c3-411b-4a9f-acba-c4f853014274 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:13.492890 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3304e0c3-411b-4a9f-acba-c4f853014274 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:13.499321 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3304e0c3-411b-4a9f-acba-c4f853014274 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:13.499779 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3304e0c3-411b-4a9f-acba-c4f853014274 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:13.500554 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3304e0c3-411b-4a9f-acba-c4f853014274 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:13.500995 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3304e0c3-411b-4a9f-acba-c4f853014274 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:13.637087 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3304e0c3-411b-4a9f-acba-c4f853014274 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:13.644504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3304e0c3-411b-4a9f-acba-c4f853014274 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1259 microversion: 2.1 time: 0.157357 Jul 29 11:54:13.645729 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 410/806] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:13 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:14.666386 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ff64f072-643c-411d-928e-1df08346cfc1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:14.666933 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ff64f072-643c-411d-928e-1df08346cfc1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:14.673503 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ff64f072-643c-411d-928e-1df08346cfc1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:14.673965 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ff64f072-643c-411d-928e-1df08346cfc1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:14.674740 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ff64f072-643c-411d-928e-1df08346cfc1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:14.675183 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ff64f072-643c-411d-928e-1df08346cfc1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:14.804238 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ff64f072-643c-411d-928e-1df08346cfc1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:14.811619 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ff64f072-643c-411d-928e-1df08346cfc1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1442 microversion: 2.1 time: 0.149314 Jul 29 11:54:14.812179 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 397/807] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:14 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1442 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:14.831960 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c353f40e-1579-4399-b1dc-0fd465ac1370 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:14.833248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c353f40e-1579-4399-b1dc-0fd465ac1370 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:14.839667 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c353f40e-1579-4399-b1dc-0fd465ac1370 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:14.840120 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c353f40e-1579-4399-b1dc-0fd465ac1370 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:14.840887 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c353f40e-1579-4399-b1dc-0fd465ac1370 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:14.841328 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c353f40e-1579-4399-b1dc-0fd465ac1370 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:14.974271 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c353f40e-1579-4399-b1dc-0fd465ac1370 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:14.981664 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c353f40e-1579-4399-b1dc-0fd465ac1370 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1442 microversion: 2.1 time: 0.153503 Jul 29 11:54:14.982233 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 411/808] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:14 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:17.006548 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-de10c0b5-da6b-40fb-8107-872b75e832bc req-f8d4863b-2f7b-4c4a-9bc6-c86b96c1b8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ff3352-15b3-4066-b66b-fe3e5c4ff2d6", "tag": "7db84d29-10d0-41a8-abf4-9bb896740271"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:54:17.016630 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-de10c0b5-da6b-40fb-8107-872b75e832bc req-f8d4863b-2f7b-4c4a-9bc6-c86b96c1b8c5 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:17.017079 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-de10c0b5-da6b-40fb-8107-872b75e832bc req-f8d4863b-2f7b-4c4a-9bc6-c86b96c1b8c5 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:17.028292 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-de10c0b5-da6b-40fb-8107-872b75e832bc req-f8d4863b-2f7b-4c4a-9bc6-c86b96c1b8c5 service nova] Creating event network-changed:7db84d29-10d0-41a8-abf4-9bb896740271 for instance 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 on hv-cinder-83754 Jul 29 11:54:17.033239 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-de10c0b5-da6b-40fb-8107-872b75e832bc req-f8d4863b-2f7b-4c4a-9bc6-c86b96c1b8c5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031755 Jul 29 11:54:17.034056 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 398/809] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:54:28.598154 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-dacb1363-129e-4779-8810-f66bb5f807be tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:28.598735 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-dacb1363-129e-4779-8810-f66bb5f807be tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:28.601214 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=15 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:28.601908 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=39 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:28.607931 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dacb1363-129e-4779-8810-f66bb5f807be tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:28.608392 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dacb1363-129e-4779-8810-f66bb5f807be tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:28.609162 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dacb1363-129e-4779-8810-f66bb5f807be tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:28.609812 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dacb1363-129e-4779-8810-f66bb5f807be tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:28.632857 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-dacb1363-129e-4779-8810-f66bb5f807be tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/ips" status: 200 len: 146 microversion: 2.1 time: 0.039207 Jul 29 11:54:28.633433 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 412/810] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Jul 29 11:54:28 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:54:34.462924 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=13 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:34.463722 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=44 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:34.468068 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-7cbc14fe-0a71-449b-9fdc-64893bb5efdb tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "763747ee-7f6e-48b4-8113-aef55bd07e70"}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:54:34.470501 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-7cbc14fe-0a71-449b-9fdc-64893bb5efdb tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:34.478693 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7cbc14fe-0a71-449b-9fdc-64893bb5efdb tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:34.479258 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7cbc14fe-0a71-449b-9fdc-64893bb5efdb tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:34.480128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7cbc14fe-0a71-449b-9fdc-64893bb5efdb tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:34.480664 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7cbc14fe-0a71-449b-9fdc-64893bb5efdb tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:34.729622 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-7cbc14fe-0a71-449b-9fdc-64893bb5efdb tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "POST /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267539 Jul 29 11:54:34.730396 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 399/811] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Jul 29 11:54:34 2022] POST /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:54:42.259955 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f4cb3f3a-5e70-4b67-9fbc-1943a82c0fdf tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:54:42.262202 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=2 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:42.263017 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=4 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:54:42.268569 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f4cb3f3a-5e70-4b67-9fbc-1943a82c0fdf tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:42.269017 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f4cb3f3a-5e70-4b67-9fbc-1943a82c0fdf tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:42.327410 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f4cb3f3a-5e70-4b67-9fbc-1943a82c0fdf tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Going to try to stop instance {{(pid=129584) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 29 11:54:42.371433 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f4cb3f3a-5e70-4b67-9fbc-1943a82c0fdf tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "POST /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/action" status: 202 len: 0 microversion: 2.1 time: 0.116332 Jul 29 11:54:42.372038 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 413/812] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Jul 29 11:54:42 2022] POST /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:54:42.380713 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-95a1ed02-c9f4-4a20-b903-e17f16ad314d tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:42.381474 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-95a1ed02-c9f4-4a20-b903-e17f16ad314d tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:42.389848 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-95a1ed02-c9f4-4a20-b903-e17f16ad314d tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:42.390443 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-95a1ed02-c9f4-4a20-b903-e17f16ad314d tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:42.391422 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-95a1ed02-c9f4-4a20-b903-e17f16ad314d tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:42.391984 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-95a1ed02-c9f4-4a20-b903-e17f16ad314d tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:42.525252 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-95a1ed02-c9f4-4a20-b903-e17f16ad314d tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:42.533330 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-95a1ed02-c9f4-4a20-b903-e17f16ad314d tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1723 microversion: 2.1 time: 0.156870 Jul 29 11:54:42.533926 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 400/813] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:42 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:43.556458 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-086f2106-0d8e-4f1e-9c3b-28fce72a0813 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:43.557145 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-086f2106-0d8e-4f1e-9c3b-28fce72a0813 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:43.563417 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-086f2106-0d8e-4f1e-9c3b-28fce72a0813 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:43.563875 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-086f2106-0d8e-4f1e-9c3b-28fce72a0813 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:43.564675 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-086f2106-0d8e-4f1e-9c3b-28fce72a0813 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:43.565125 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-086f2106-0d8e-4f1e-9c3b-28fce72a0813 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:43.696337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-086f2106-0d8e-4f1e-9c3b-28fce72a0813 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:43.704315 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-086f2106-0d8e-4f1e-9c3b-28fce72a0813 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1723 microversion: 2.1 time: 0.152621 Jul 29 11:54:43.704876 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 414/814] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:43 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:44.726693 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-fa8550b3-da09-4ab0-9fac-927e60ce37ee tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:44.727325 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-fa8550b3-da09-4ab0-9fac-927e60ce37ee tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:44.734432 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fa8550b3-da09-4ab0-9fac-927e60ce37ee tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:44.734878 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fa8550b3-da09-4ab0-9fac-927e60ce37ee tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:44.735691 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fa8550b3-da09-4ab0-9fac-927e60ce37ee tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:44.736127 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fa8550b3-da09-4ab0-9fac-927e60ce37ee tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:44.875702 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fa8550b3-da09-4ab0-9fac-927e60ce37ee tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:44.884553 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-fa8550b3-da09-4ab0-9fac-927e60ce37ee tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1723 microversion: 2.1 time: 0.162286 Jul 29 11:54:44.885125 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 401/815] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:44 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:45.906436 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-280274f4-9f25-485c-98ad-5f547c984b2f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:45.907061 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-280274f4-9f25-485c-98ad-5f547c984b2f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:45.914303 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-280274f4-9f25-485c-98ad-5f547c984b2f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:45.914759 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-280274f4-9f25-485c-98ad-5f547c984b2f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:45.915527 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-280274f4-9f25-485c-98ad-5f547c984b2f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:45.915968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-280274f4-9f25-485c-98ad-5f547c984b2f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:46.043823 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-280274f4-9f25-485c-98ad-5f547c984b2f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:46.051681 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-280274f4-9f25-485c-98ad-5f547c984b2f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1723 microversion: 2.1 time: 0.149097 Jul 29 11:54:46.052239 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 415/816] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:45 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:47.072545 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a218034b-fd9e-48e5-b459-dafee0a4f779 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:47.073148 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a218034b-fd9e-48e5-b459-dafee0a4f779 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:47.079609 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a218034b-fd9e-48e5-b459-dafee0a4f779 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:47.080058 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a218034b-fd9e-48e5-b459-dafee0a4f779 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:47.080834 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a218034b-fd9e-48e5-b459-dafee0a4f779 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:47.081268 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a218034b-fd9e-48e5-b459-dafee0a4f779 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:47.363592 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a218034b-fd9e-48e5-b459-dafee0a4f779 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:47.372022 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a218034b-fd9e-48e5-b459-dafee0a4f779 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1723 microversion: 2.1 time: 0.303325 Jul 29 11:54:47.372573 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 402/817] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:47 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:48.393078 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1a0abe4a-6d6c-4766-aa25-90b799d62e04 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:48.393718 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-1a0abe4a-6d6c-4766-aa25-90b799d62e04 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:48.400290 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1a0abe4a-6d6c-4766-aa25-90b799d62e04 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:48.400750 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1a0abe4a-6d6c-4766-aa25-90b799d62e04 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:48.401540 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1a0abe4a-6d6c-4766-aa25-90b799d62e04 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:48.401989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1a0abe4a-6d6c-4766-aa25-90b799d62e04 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:48.530387 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1a0abe4a-6d6c-4766-aa25-90b799d62e04 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:48.538749 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1a0abe4a-6d6c-4766-aa25-90b799d62e04 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1723 microversion: 2.1 time: 0.149527 Jul 29 11:54:48.539315 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 416/818] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:48 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:49.560166 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c03bccc9-b4e8-4024-8138-2fa17d1ddb09 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:49.560701 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-c03bccc9-b4e8-4024-8138-2fa17d1ddb09 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:49.567199 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c03bccc9-b4e8-4024-8138-2fa17d1ddb09 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:49.567654 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c03bccc9-b4e8-4024-8138-2fa17d1ddb09 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:49.568416 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c03bccc9-b4e8-4024-8138-2fa17d1ddb09 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:49.569376 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c03bccc9-b4e8-4024-8138-2fa17d1ddb09 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:49.698618 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-c03bccc9-b4e8-4024-8138-2fa17d1ddb09 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:49.706613 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-c03bccc9-b4e8-4024-8138-2fa17d1ddb09 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1723 microversion: 2.1 time: 0.150432 Jul 29 11:54:49.707167 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 403/819] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:49 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:50.728199 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1d01524d-a5c7-4886-865c-be77bd9a24fd tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:50.728820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-1d01524d-a5c7-4886-865c-be77bd9a24fd tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:50.735320 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1d01524d-a5c7-4886-865c-be77bd9a24fd tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:50.735777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1d01524d-a5c7-4886-865c-be77bd9a24fd tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:50.736545 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1d01524d-a5c7-4886-865c-be77bd9a24fd tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:50.736988 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1d01524d-a5c7-4886-865c-be77bd9a24fd tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:51.014883 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1d01524d-a5c7-4886-865c-be77bd9a24fd tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:51.023574 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1d01524d-a5c7-4886-865c-be77bd9a24fd tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1723 microversion: 2.1 time: 0.299944 Jul 29 11:54:51.024127 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 417/820] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:50 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:52.044620 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-2bedc026-d6d1-43fd-8fd4-c24164403900 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:52.045158 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-2bedc026-d6d1-43fd-8fd4-c24164403900 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:52.051736 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2bedc026-d6d1-43fd-8fd4-c24164403900 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:52.052191 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2bedc026-d6d1-43fd-8fd4-c24164403900 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:52.053042 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2bedc026-d6d1-43fd-8fd4-c24164403900 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:52.054039 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2bedc026-d6d1-43fd-8fd4-c24164403900 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:52.181730 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-2bedc026-d6d1-43fd-8fd4-c24164403900 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:52.189718 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-2bedc026-d6d1-43fd-8fd4-c24164403900 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1723 microversion: 2.1 time: 0.149009 Jul 29 11:54:52.190289 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 404/821] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:52 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:53.211266 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-cce37ccf-8476-47d6-a3ac-234ffe157128 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:53.211882 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-cce37ccf-8476-47d6-a3ac-234ffe157128 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:53.218394 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cce37ccf-8476-47d6-a3ac-234ffe157128 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:53.218846 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cce37ccf-8476-47d6-a3ac-234ffe157128 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:53.219608 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cce37ccf-8476-47d6-a3ac-234ffe157128 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:53.220075 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cce37ccf-8476-47d6-a3ac-234ffe157128 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:53.349725 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-cce37ccf-8476-47d6-a3ac-234ffe157128 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:53.358217 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-cce37ccf-8476-47d6-a3ac-234ffe157128 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1723 microversion: 2.1 time: 0.151455 Jul 29 11:54:53.358766 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 418/822] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:53 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:54.378974 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-adb3fe94-0d6d-4d69-be22-deb5e8efbbd3 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:54.379588 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-adb3fe94-0d6d-4d69-be22-deb5e8efbbd3 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:54.386418 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-adb3fe94-0d6d-4d69-be22-deb5e8efbbd3 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:54.386881 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-adb3fe94-0d6d-4d69-be22-deb5e8efbbd3 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:54.387625 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-adb3fe94-0d6d-4d69-be22-deb5e8efbbd3 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:54.388054 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-adb3fe94-0d6d-4d69-be22-deb5e8efbbd3 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:54.523186 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-adb3fe94-0d6d-4d69-be22-deb5e8efbbd3 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:54.531154 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-adb3fe94-0d6d-4d69-be22-deb5e8efbbd3 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1723 microversion: 2.1 time: 0.156067 Jul 29 11:54:54.531720 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 405/823] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:54 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:55.554981 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-0f06156f-4284-4309-b39e-9361b1dba290 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:55.555599 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-0f06156f-4284-4309-b39e-9361b1dba290 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:55.562115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0f06156f-4284-4309-b39e-9361b1dba290 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:55.562570 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0f06156f-4284-4309-b39e-9361b1dba290 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:55.563342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0f06156f-4284-4309-b39e-9361b1dba290 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:55.563777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0f06156f-4284-4309-b39e-9361b1dba290 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:55.695200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-0f06156f-4284-4309-b39e-9361b1dba290 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:55.703238 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-0f06156f-4284-4309-b39e-9361b1dba290 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1723 microversion: 2.1 time: 0.153004 Jul 29 11:54:55.703707 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 419/824] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:55 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:56.724070 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-50b7415a-8720-4be1-8ab4-5212dd80a44e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:56.724689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-50b7415a-8720-4be1-8ab4-5212dd80a44e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:56.731412 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-50b7415a-8720-4be1-8ab4-5212dd80a44e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:56.731871 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-50b7415a-8720-4be1-8ab4-5212dd80a44e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:56.732639 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-50b7415a-8720-4be1-8ab4-5212dd80a44e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:56.733080 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-50b7415a-8720-4be1-8ab4-5212dd80a44e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:56.860343 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-50b7415a-8720-4be1-8ab4-5212dd80a44e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:56.868794 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-50b7415a-8720-4be1-8ab4-5212dd80a44e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1723 microversion: 2.1 time: 0.148590 Jul 29 11:54:56.869361 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 406/825] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:56 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:57.896743 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-bb2bbd59-acb4-45f8-a8a1-67048df0d9e4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:57.897492 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-bb2bbd59-acb4-45f8-a8a1-67048df0d9e4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:57.905268 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bb2bbd59-acb4-45f8-a8a1-67048df0d9e4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:57.905766 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bb2bbd59-acb4-45f8-a8a1-67048df0d9e4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:57.906550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bb2bbd59-acb4-45f8-a8a1-67048df0d9e4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:57.906993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bb2bbd59-acb4-45f8-a8a1-67048df0d9e4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:58.036487 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bb2bbd59-acb4-45f8-a8a1-67048df0d9e4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:58.045005 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-bb2bbd59-acb4-45f8-a8a1-67048df0d9e4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1700 microversion: 2.1 time: 0.158407 Jul 29 11:54:58.045583 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 420/826] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:57 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1700 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:54:58.064985 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-bf4a87db-2617-463f-961f-2a787b2626fc tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:54:58.072114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bf4a87db-2617-463f-961f-2a787b2626fc tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:58.072565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bf4a87db-2617-463f-961f-2a787b2626fc tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:58.134612 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-bf4a87db-2617-463f-961f-2a787b2626fc tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Going to try to start instance {{(pid=129585) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 29 11:54:58.176278 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-bf4a87db-2617-463f-961f-2a787b2626fc tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "POST /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/action" status: 202 len: 0 microversion: 2.1 time: 0.114923 Jul 29 11:54:58.176875 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 407/827] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Jul 29 11:54:58 2022] POST /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:54:58.185348 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-bf1e22df-2c53-443b-8962-59b96ede0d5a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:58.185989 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-bf1e22df-2c53-443b-8962-59b96ede0d5a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:58.192754 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bf1e22df-2c53-443b-8962-59b96ede0d5a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:58.192754 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bf1e22df-2c53-443b-8962-59b96ede0d5a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:58.193509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bf1e22df-2c53-443b-8962-59b96ede0d5a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:58.194478 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bf1e22df-2c53-443b-8962-59b96ede0d5a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:58.332470 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bf1e22df-2c53-443b-8962-59b96ede0d5a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:58.341466 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-bf1e22df-2c53-443b-8962-59b96ede0d5a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1709 microversion: 2.1 time: 0.159861 Jul 29 11:54:58.342174 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 421/828] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:58 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:54:59.362624 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-daea647c-d7fb-48e2-be48-c5abe2d549bb tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:54:59.363327 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-daea647c-d7fb-48e2-be48-c5abe2d549bb tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:54:59.370171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-daea647c-d7fb-48e2-be48-c5abe2d549bb tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:59.371352 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-daea647c-d7fb-48e2-be48-c5abe2d549bb tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:59.371482 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-daea647c-d7fb-48e2-be48-c5abe2d549bb tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:54:59.371820 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-daea647c-d7fb-48e2-be48-c5abe2d549bb tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:54:59.499842 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-daea647c-d7fb-48e2-be48-c5abe2d549bb tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:54:59.508410 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-daea647c-d7fb-48e2-be48-c5abe2d549bb tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1709 microversion: 2.1 time: 0.150166 Jul 29 11:54:59.508974 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 408/829] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:54:59 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:55:00.530164 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c72b9d1e-c3ef-4b1b-a6ae-3589d894bb7b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:55:00.530724 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c72b9d1e-c3ef-4b1b-a6ae-3589d894bb7b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:55:00.537199 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c72b9d1e-c3ef-4b1b-a6ae-3589d894bb7b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:00.538247 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c72b9d1e-c3ef-4b1b-a6ae-3589d894bb7b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:00.539015 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c72b9d1e-c3ef-4b1b-a6ae-3589d894bb7b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:00.539479 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c72b9d1e-c3ef-4b1b-a6ae-3589d894bb7b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:00.671381 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c72b9d1e-c3ef-4b1b-a6ae-3589d894bb7b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:55:00.679911 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c72b9d1e-c3ef-4b1b-a6ae-3589d894bb7b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1713 microversion: 2.1 time: 0.153659 Jul 29 11:55:00.680463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 422/830] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:55:00 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1713 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:55:34.251577 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-eb1dea0d-fbd7-4179-a6b0-f84bc168030a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:55:34.252166 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-eb1dea0d-fbd7-4179-a6b0-f84bc168030a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:55:34.254195 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=20 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:55:34.254979 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:55:34.262008 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-eb1dea0d-fbd7-4179-a6b0-f84bc168030a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:34.262468 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-eb1dea0d-fbd7-4179-a6b0-f84bc168030a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:34.263276 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-eb1dea0d-fbd7-4179-a6b0-f84bc168030a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:34.263722 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-eb1dea0d-fbd7-4179-a6b0-f84bc168030a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:34.344136 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.objects.instance [None req-eb1dea0d-fbd7-4179-a6b0-f84bc168030a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lazy-loading 'services' on Instance uuid 55552e03-f570-4ef7-b624-83ed029e89a9 {{(pid=129585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:55:34.421883 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-eb1dea0d-fbd7-4179-a6b0-f84bc168030a tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/os-volume_attachments/763747ee-7f6e-48b4-8113-aef55bd07e70" status: 202 len: 0 microversion: 2.1 time: 0.174233 Jul 29 11:55:34.422459 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 409/831] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Jul 29 11:55:34 2022] DELETE /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/os-volume_attachments/763747ee-7f6e-48b4-8113-aef55bd07e70 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:55:35.539677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-a26225a7-e33d-4f4c-b30b-805a7783f5b3 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:55:35.541947 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=20 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:55:35.542613 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:55:35.548398 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a26225a7-e33d-4f4c-b30b-805a7783f5b3 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:35.548854 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-a26225a7-e33d-4f4c-b30b-805a7783f5b3 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:35.572047 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-a26225a7-e33d-4f4c-b30b-805a7783f5b3 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Going to try to stop instance {{(pid=129584) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 29 11:55:35.613846 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-a26225a7-e33d-4f4c-b30b-805a7783f5b3 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "POST /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/action" status: 202 len: 0 microversion: 2.1 time: 0.078029 Jul 29 11:55:35.614812 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 423/832] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Jul 29 11:55:35 2022] POST /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:55:35.623960 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-501d5dd3-4483-4a6f-9f1d-624aaa70b53b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:55:35.624679 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-501d5dd3-4483-4a6f-9f1d-624aaa70b53b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:55:35.632332 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-501d5dd3-4483-4a6f-9f1d-624aaa70b53b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:35.632831 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-501d5dd3-4483-4a6f-9f1d-624aaa70b53b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:35.633657 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-501d5dd3-4483-4a6f-9f1d-624aaa70b53b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:35.634374 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-501d5dd3-4483-4a6f-9f1d-624aaa70b53b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:35.767005 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-501d5dd3-4483-4a6f-9f1d-624aaa70b53b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:55:35.774699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-501d5dd3-4483-4a6f-9f1d-624aaa70b53b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1677 microversion: 2.1 time: 0.155508 Jul 29 11:55:35.775267 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 410/833] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:55:35 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:55:36.796796 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-dc814407-ac13-4445-b4cc-9979d507c071 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:55:36.797563 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-dc814407-ac13-4445-b4cc-9979d507c071 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:55:36.804088 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dc814407-ac13-4445-b4cc-9979d507c071 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:36.804541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dc814407-ac13-4445-b4cc-9979d507c071 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:36.805308 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dc814407-ac13-4445-b4cc-9979d507c071 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:36.805766 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dc814407-ac13-4445-b4cc-9979d507c071 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:36.937011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-dc814407-ac13-4445-b4cc-9979d507c071 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:55:36.945251 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-dc814407-ac13-4445-b4cc-9979d507c071 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1677 microversion: 2.1 time: 0.153224 Jul 29 11:55:36.945837 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 424/834] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:55:36 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:55:37.966864 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-7058199d-b1f2-4b14-bb1c-915f62edb58f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:55:37.967492 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-7058199d-b1f2-4b14-bb1c-915f62edb58f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:55:37.974123 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7058199d-b1f2-4b14-bb1c-915f62edb58f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:37.974632 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7058199d-b1f2-4b14-bb1c-915f62edb58f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:37.975358 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7058199d-b1f2-4b14-bb1c-915f62edb58f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:37.975797 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7058199d-b1f2-4b14-bb1c-915f62edb58f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:38.102383 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-7058199d-b1f2-4b14-bb1c-915f62edb58f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:55:38.109816 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-7058199d-b1f2-4b14-bb1c-915f62edb58f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1677 microversion: 2.1 time: 0.146782 Jul 29 11:55:38.110491 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 411/835] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:55:37 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:55:39.132080 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-12de6813-3285-4561-a9d3-6830de3e96c5 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:55:39.132635 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-12de6813-3285-4561-a9d3-6830de3e96c5 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:55:39.139396 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-12de6813-3285-4561-a9d3-6830de3e96c5 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:39.139853 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-12de6813-3285-4561-a9d3-6830de3e96c5 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:39.140620 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-12de6813-3285-4561-a9d3-6830de3e96c5 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:39.141054 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-12de6813-3285-4561-a9d3-6830de3e96c5 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:39.268375 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-12de6813-3285-4561-a9d3-6830de3e96c5 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:55:39.276032 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-12de6813-3285-4561-a9d3-6830de3e96c5 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1677 microversion: 2.1 time: 0.148115 Jul 29 11:55:39.276590 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 425/836] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:55:39 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:55:40.297588 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-42be9c28-762c-4eac-88f4-3d0d310eb264 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:55:40.298212 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-42be9c28-762c-4eac-88f4-3d0d310eb264 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:55:40.305577 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-42be9c28-762c-4eac-88f4-3d0d310eb264 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:40.306040 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-42be9c28-762c-4eac-88f4-3d0d310eb264 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:40.306820 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-42be9c28-762c-4eac-88f4-3d0d310eb264 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:40.307266 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-42be9c28-762c-4eac-88f4-3d0d310eb264 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:40.441083 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-42be9c28-762c-4eac-88f4-3d0d310eb264 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:55:40.449228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-42be9c28-762c-4eac-88f4-3d0d310eb264 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1677 microversion: 2.1 time: 0.155499 Jul 29 11:55:40.449766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 412/837] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:55:40 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:55:41.470013 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4754a168-4122-48df-aee1-6d62ecb57842 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:55:41.470564 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-4754a168-4122-48df-aee1-6d62ecb57842 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:55:41.477096 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4754a168-4122-48df-aee1-6d62ecb57842 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:41.477583 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4754a168-4122-48df-aee1-6d62ecb57842 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:41.478350 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4754a168-4122-48df-aee1-6d62ecb57842 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:41.478790 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4754a168-4122-48df-aee1-6d62ecb57842 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:41.606013 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4754a168-4122-48df-aee1-6d62ecb57842 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:55:41.613320 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-4754a168-4122-48df-aee1-6d62ecb57842 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1677 microversion: 2.1 time: 0.147211 Jul 29 11:55:41.614105 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 426/838] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:55:41 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:55:42.634912 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ee57192d-7639-4fa5-a9bc-db84e9146680 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:55:42.635450 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ee57192d-7639-4fa5-a9bc-db84e9146680 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:55:42.641409 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ee57192d-7639-4fa5-a9bc-db84e9146680 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:42.641886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ee57192d-7639-4fa5-a9bc-db84e9146680 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:42.642640 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ee57192d-7639-4fa5-a9bc-db84e9146680 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:42.643071 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ee57192d-7639-4fa5-a9bc-db84e9146680 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:42.773718 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ee57192d-7639-4fa5-a9bc-db84e9146680 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:55:42.781139 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ee57192d-7639-4fa5-a9bc-db84e9146680 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1677 microversion: 2.1 time: 0.150704 Jul 29 11:55:42.781730 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 413/839] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:55:42 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:55:43.803480 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c7a7e36e-5c2c-4a62-a62a-c450f0e0ab72 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:55:43.804100 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c7a7e36e-5c2c-4a62-a62a-c450f0e0ab72 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:55:43.810623 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c7a7e36e-5c2c-4a62-a62a-c450f0e0ab72 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:43.811075 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c7a7e36e-5c2c-4a62-a62a-c450f0e0ab72 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:43.811842 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c7a7e36e-5c2c-4a62-a62a-c450f0e0ab72 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:43.812288 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c7a7e36e-5c2c-4a62-a62a-c450f0e0ab72 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:43.938639 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c7a7e36e-5c2c-4a62-a62a-c450f0e0ab72 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:55:43.946308 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c7a7e36e-5c2c-4a62-a62a-c450f0e0ab72 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1677 microversion: 2.1 time: 0.147460 Jul 29 11:55:43.946864 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 427/840] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:55:43 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:55:44.967557 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c703a4da-eb43-42db-ba45-b445d3b9a68b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:55:44.968182 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-c703a4da-eb43-42db-ba45-b445d3b9a68b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:55:44.975206 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c703a4da-eb43-42db-ba45-b445d3b9a68b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:44.975701 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c703a4da-eb43-42db-ba45-b445d3b9a68b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:44.976476 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c703a4da-eb43-42db-ba45-b445d3b9a68b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:44.976921 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c703a4da-eb43-42db-ba45-b445d3b9a68b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:45.102884 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-c703a4da-eb43-42db-ba45-b445d3b9a68b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:55:45.110432 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-c703a4da-eb43-42db-ba45-b445d3b9a68b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1677 microversion: 2.1 time: 0.146835 Jul 29 11:55:45.111016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 414/841] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:55:44 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:55:46.132787 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e9a3d35b-0000-4853-8a09-efff873a567c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:55:46.133398 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e9a3d35b-0000-4853-8a09-efff873a567c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:55:46.140200 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e9a3d35b-0000-4853-8a09-efff873a567c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:46.140650 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e9a3d35b-0000-4853-8a09-efff873a567c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:46.141426 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e9a3d35b-0000-4853-8a09-efff873a567c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:46.141879 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e9a3d35b-0000-4853-8a09-efff873a567c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:46.275099 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e9a3d35b-0000-4853-8a09-efff873a567c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:55:46.282533 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e9a3d35b-0000-4853-8a09-efff873a567c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1654 microversion: 2.1 time: 0.154389 Jul 29 11:55:46.283088 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 428/842] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:55:46 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1654 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:55:46.302774 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-aa723f72-0dd3-4c8b-a590-a2d5fe65054e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:55:46.309360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-aa723f72-0dd3-4c8b-a590-a2d5fe65054e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:46.309853 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-aa723f72-0dd3-4c8b-a590-a2d5fe65054e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:46.331666 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-aa723f72-0dd3-4c8b-a590-a2d5fe65054e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Going to try to start instance {{(pid=129585) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 29 11:55:46.372589 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-aa723f72-0dd3-4c8b-a590-a2d5fe65054e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "POST /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/action" status: 202 len: 0 microversion: 2.1 time: 0.074043 Jul 29 11:55:46.373184 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 415/843] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Jul 29 11:55:46 2022] POST /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:55:46.382151 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-95a4b26d-ea4d-43b2-a7b1-7eb5d68ccf01 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:55:46.382780 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-95a4b26d-ea4d-43b2-a7b1-7eb5d68ccf01 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:55:46.389216 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-95a4b26d-ea4d-43b2-a7b1-7eb5d68ccf01 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:46.389648 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-95a4b26d-ea4d-43b2-a7b1-7eb5d68ccf01 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:46.390430 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-95a4b26d-ea4d-43b2-a7b1-7eb5d68ccf01 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:46.390872 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-95a4b26d-ea4d-43b2-a7b1-7eb5d68ccf01 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:46.525503 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-95a4b26d-ea4d-43b2-a7b1-7eb5d68ccf01 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:55:46.533014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-95a4b26d-ea4d-43b2-a7b1-7eb5d68ccf01 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1663 microversion: 2.1 time: 0.155316 Jul 29 11:55:46.533605 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 429/844] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:55:46 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:55:47.555405 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-912ee4b8-2b1b-46d0-a75b-e6af4a7ff7ef tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:55:47.556136 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-912ee4b8-2b1b-46d0-a75b-e6af4a7ff7ef tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:55:47.562370 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-912ee4b8-2b1b-46d0-a75b-e6af4a7ff7ef tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:47.562824 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-912ee4b8-2b1b-46d0-a75b-e6af4a7ff7ef tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:47.563591 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-912ee4b8-2b1b-46d0-a75b-e6af4a7ff7ef tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:47.564027 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-912ee4b8-2b1b-46d0-a75b-e6af4a7ff7ef tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:47.701078 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-912ee4b8-2b1b-46d0-a75b-e6af4a7ff7ef tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:55:47.709444 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-912ee4b8-2b1b-46d0-a75b-e6af4a7ff7ef tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1663 microversion: 2.1 time: 0.158867 Jul 29 11:55:47.710001 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 416/845] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:55:47 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:55:48.730478 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-05cb8fe6-1631-4165-be63-3fdbe5039811 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:55:48.731098 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-05cb8fe6-1631-4165-be63-3fdbe5039811 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:55:48.737657 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-05cb8fe6-1631-4165-be63-3fdbe5039811 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:48.738114 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-05cb8fe6-1631-4165-be63-3fdbe5039811 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:48.738886 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-05cb8fe6-1631-4165-be63-3fdbe5039811 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:55:48.739322 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-05cb8fe6-1631-4165-be63-3fdbe5039811 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:55:48.868734 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-05cb8fe6-1631-4165-be63-3fdbe5039811 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:55:48.876239 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-05cb8fe6-1631-4165-be63-3fdbe5039811 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1667 microversion: 2.1 time: 0.149698 Jul 29 11:55:48.876787 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 430/846] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:55:48 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:15.521824 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-f5813f4d-e2fe-4e17-a16e-d752a04d0aea tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:56:15.522425 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-f5813f4d-e2fe-4e17-a16e-d752a04d0aea tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:15.524384 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=16 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:56:15.525036 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:56:15.530659 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f5813f4d-e2fe-4e17-a16e-d752a04d0aea tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:15.531107 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f5813f4d-e2fe-4e17-a16e-d752a04d0aea tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:15.531867 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f5813f4d-e2fe-4e17-a16e-d752a04d0aea tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:15.532301 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f5813f4d-e2fe-4e17-a16e-d752a04d0aea tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:15.555245 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.objects.instance [None req-f5813f4d-e2fe-4e17-a16e-d752a04d0aea tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lazy-loading 'flavor' on Instance uuid 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 {{(pid=129585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:56:15.624988 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-f5813f4d-e2fe-4e17-a16e-d752a04d0aea tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "POST /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6/action" status: 202 len: 0 microversion: 2.1 time: 0.107921 Jul 29 11:56:15.625610 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 417/847] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Jul 29 11:56:15 2022] POST /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:56:15.635367 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c70ef7f3-33eb-4866-a20f-15d3402ff54d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:15.635995 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c70ef7f3-33eb-4866-a20f-15d3402ff54d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:15.638314 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=16 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:56:15.639088 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:56:15.646100 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c70ef7f3-33eb-4866-a20f-15d3402ff54d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:15.646697 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c70ef7f3-33eb-4866-a20f-15d3402ff54d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:15.647702 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c70ef7f3-33eb-4866-a20f-15d3402ff54d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:15.648207 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c70ef7f3-33eb-4866-a20f-15d3402ff54d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:15.785746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c70ef7f3-33eb-4866-a20f-15d3402ff54d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:15.793253 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c70ef7f3-33eb-4866-a20f-15d3402ff54d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.162796 Jul 29 11:56:15.793864 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 431/848] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:15 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:16.815703 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ad5efdf5-e59f-4f8b-ba5e-6f0684d0e303 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:16.816399 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ad5efdf5-e59f-4f8b-ba5e-6f0684d0e303 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:16.822748 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ad5efdf5-e59f-4f8b-ba5e-6f0684d0e303 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:16.823195 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ad5efdf5-e59f-4f8b-ba5e-6f0684d0e303 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:16.823950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ad5efdf5-e59f-4f8b-ba5e-6f0684d0e303 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:16.824381 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ad5efdf5-e59f-4f8b-ba5e-6f0684d0e303 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:16.963328 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ad5efdf5-e59f-4f8b-ba5e-6f0684d0e303 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:16.970989 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ad5efdf5-e59f-4f8b-ba5e-6f0684d0e303 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.159980 Jul 29 11:56:16.971561 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 418/849] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:16 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:17.992395 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-8b8eede3-b667-47a6-b4a5-ff186a999e72 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:17.993008 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-8b8eede3-b667-47a6-b4a5-ff186a999e72 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:17.999961 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8b8eede3-b667-47a6-b4a5-ff186a999e72 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:18.000376 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8b8eede3-b667-47a6-b4a5-ff186a999e72 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:18.001143 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8b8eede3-b667-47a6-b4a5-ff186a999e72 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:18.001619 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8b8eede3-b667-47a6-b4a5-ff186a999e72 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:18.129339 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-8b8eede3-b667-47a6-b4a5-ff186a999e72 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:18.136982 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-8b8eede3-b667-47a6-b4a5-ff186a999e72 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.149110 Jul 29 11:56:18.137553 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 432/850] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:17 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:19.157911 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9275881e-5078-4b23-b414-559e25c1fb04 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:19.158457 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9275881e-5078-4b23-b414-559e25c1fb04 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:19.165090 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9275881e-5078-4b23-b414-559e25c1fb04 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:19.165581 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9275881e-5078-4b23-b414-559e25c1fb04 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:19.166344 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9275881e-5078-4b23-b414-559e25c1fb04 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:19.166781 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9275881e-5078-4b23-b414-559e25c1fb04 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:19.301575 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9275881e-5078-4b23-b414-559e25c1fb04 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:19.309105 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9275881e-5078-4b23-b414-559e25c1fb04 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.155239 Jul 29 11:56:19.309705 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 419/851] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:19 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:20.329949 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5a65dbca-1dfe-40cf-aaf7-4f9816447d7a tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:20.330559 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-5a65dbca-1dfe-40cf-aaf7-4f9816447d7a tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:20.337625 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5a65dbca-1dfe-40cf-aaf7-4f9816447d7a tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:20.338073 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5a65dbca-1dfe-40cf-aaf7-4f9816447d7a tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:20.338834 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5a65dbca-1dfe-40cf-aaf7-4f9816447d7a tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:20.339270 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5a65dbca-1dfe-40cf-aaf7-4f9816447d7a tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:20.467715 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5a65dbca-1dfe-40cf-aaf7-4f9816447d7a tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:20.475351 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-5a65dbca-1dfe-40cf-aaf7-4f9816447d7a tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.149240 Jul 29 11:56:20.475913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 433/852] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:20 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:21.497109 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-851a03b1-ea5e-4fdf-aa90-4788c68bebcd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:21.497678 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-851a03b1-ea5e-4fdf-aa90-4788c68bebcd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:21.504270 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-851a03b1-ea5e-4fdf-aa90-4788c68bebcd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:21.504728 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-851a03b1-ea5e-4fdf-aa90-4788c68bebcd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:21.508373 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-851a03b1-ea5e-4fdf-aa90-4788c68bebcd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:21.509094 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-851a03b1-ea5e-4fdf-aa90-4788c68bebcd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:21.819804 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-851a03b1-ea5e-4fdf-aa90-4788c68bebcd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:21.827294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-851a03b1-ea5e-4fdf-aa90-4788c68bebcd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.334420 Jul 29 11:56:21.827853 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 420/853] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:21 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:22.266530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-99c4d1b2-2711-4b9f-95a5-3a903a72ed37 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:22.268699 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-99c4d1b2-2711-4b9f-95a5-3a903a72ed37 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:22.275934 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-99c4d1b2-2711-4b9f-95a5-3a903a72ed37 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:22.276387 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-99c4d1b2-2711-4b9f-95a5-3a903a72ed37 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:22.277161 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-99c4d1b2-2711-4b9f-95a5-3a903a72ed37 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:22.277635 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-99c4d1b2-2711-4b9f-95a5-3a903a72ed37 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:22.306388 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-99c4d1b2-2711-4b9f-95a5-3a903a72ed37 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043936 Jul 29 11:56:22.306933 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 434/854] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:56:22 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 29 11:56:22.367757 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8ed3d6d7-b726-4ca1-b0a6-084fbd87eb99 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:22.368282 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8ed3d6d7-b726-4ca1-b0a6-084fbd87eb99 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:22.374563 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8ed3d6d7-b726-4ca1-b0a6-084fbd87eb99 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:22.375017 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8ed3d6d7-b726-4ca1-b0a6-084fbd87eb99 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:22.375783 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8ed3d6d7-b726-4ca1-b0a6-084fbd87eb99 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:22.376223 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8ed3d6d7-b726-4ca1-b0a6-084fbd87eb99 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:22.401186 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8ed3d6d7-b726-4ca1-b0a6-084fbd87eb99 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Going to try to terminate instance {{(pid=129585) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:56:22.474949 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8ed3d6d7-b726-4ca1-b0a6-084fbd87eb99 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 204 len: 0 microversion: 2.1 time: 0.110213 Jul 29 11:56:22.475394 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 421/855] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:56:22 2022] DELETE /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:56:22.483741 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-776d0a63-b73f-4069-b4a8-f0583b7d8345 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:22.484359 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-776d0a63-b73f-4069-b4a8-f0583b7d8345 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:22.490715 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-776d0a63-b73f-4069-b4a8-f0583b7d8345 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:22.491173 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-776d0a63-b73f-4069-b4a8-f0583b7d8345 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:22.491942 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-776d0a63-b73f-4069-b4a8-f0583b7d8345 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:22.492385 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-776d0a63-b73f-4069-b4a8-f0583b7d8345 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:22.672863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-776d0a63-b73f-4069-b4a8-f0583b7d8345 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:22.680555 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-776d0a63-b73f-4069-b4a8-f0583b7d8345 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1673 microversion: 2.1 time: 0.200645 Jul 29 11:56:22.681117 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 435/856] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:22 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1673 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:56:22.848866 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-afb55bff-bbb1-4024-8dbe-fe70b815bad0 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:22.849551 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-afb55bff-bbb1-4024-8dbe-fe70b815bad0 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:22.856003 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-afb55bff-bbb1-4024-8dbe-fe70b815bad0 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:22.856459 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-afb55bff-bbb1-4024-8dbe-fe70b815bad0 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:22.857222 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-afb55bff-bbb1-4024-8dbe-fe70b815bad0 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:22.857687 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-afb55bff-bbb1-4024-8dbe-fe70b815bad0 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:22.995388 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-afb55bff-bbb1-4024-8dbe-fe70b815bad0 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:23.002933 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-afb55bff-bbb1-4024-8dbe-fe70b815bad0 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.158333 Jul 29 11:56:23.003503 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 422/857] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:22 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:23.702176 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-df36d13d-4ea5-42ae-8eef-0e11da55ba19 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:23.702781 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-df36d13d-4ea5-42ae-8eef-0e11da55ba19 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:23.709727 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-df36d13d-4ea5-42ae-8eef-0e11da55ba19 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:23.710175 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-df36d13d-4ea5-42ae-8eef-0e11da55ba19 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:23.710930 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-df36d13d-4ea5-42ae-8eef-0e11da55ba19 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:23.711361 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-df36d13d-4ea5-42ae-8eef-0e11da55ba19 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:23.841954 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-df36d13d-4ea5-42ae-8eef-0e11da55ba19 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:23.849971 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-df36d13d-4ea5-42ae-8eef-0e11da55ba19 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1673 microversion: 2.1 time: 0.151041 Jul 29 11:56:23.850532 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 436/858] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:23 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:24.025489 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-b7738ac8-a569-430c-bf41-acfbfb14d5b8 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:24.026020 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-b7738ac8-a569-430c-bf41-acfbfb14d5b8 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:24.032448 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b7738ac8-a569-430c-bf41-acfbfb14d5b8 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:24.032903 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b7738ac8-a569-430c-bf41-acfbfb14d5b8 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:24.033691 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b7738ac8-a569-430c-bf41-acfbfb14d5b8 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:24.034136 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b7738ac8-a569-430c-bf41-acfbfb14d5b8 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:24.161990 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-b7738ac8-a569-430c-bf41-acfbfb14d5b8 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:24.169530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-b7738ac8-a569-430c-bf41-acfbfb14d5b8 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.148635 Jul 29 11:56:24.170103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 423/859] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:24 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:24.870668 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6f5863ea-9252-42fe-af8c-217b54f8b97e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:24.871376 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6f5863ea-9252-42fe-af8c-217b54f8b97e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:24.878091 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6f5863ea-9252-42fe-af8c-217b54f8b97e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:24.878540 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6f5863ea-9252-42fe-af8c-217b54f8b97e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:24.879313 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6f5863ea-9252-42fe-af8c-217b54f8b97e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:24.879747 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6f5863ea-9252-42fe-af8c-217b54f8b97e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:25.023090 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6f5863ea-9252-42fe-af8c-217b54f8b97e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:25.030934 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-6f5863ea-9252-42fe-af8c-217b54f8b97e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1673 microversion: 2.1 time: 0.164068 Jul 29 11:56:25.031519 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 437/860] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:24 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:25.192140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-fce519e0-5248-4707-9055-50f91e1c3a0c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:25.194209 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-fce519e0-5248-4707-9055-50f91e1c3a0c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:25.200848 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fce519e0-5248-4707-9055-50f91e1c3a0c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:25.201386 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fce519e0-5248-4707-9055-50f91e1c3a0c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:25.202264 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fce519e0-5248-4707-9055-50f91e1c3a0c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:25.202774 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fce519e0-5248-4707-9055-50f91e1c3a0c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:25.338189 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fce519e0-5248-4707-9055-50f91e1c3a0c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:25.345878 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-fce519e0-5248-4707-9055-50f91e1c3a0c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.157593 Jul 29 11:56:25.346455 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 424/861] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:25 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:25.683028 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-84f25c0b-29bc-43d9-bc73-bfa649531cff req-ca2d2acd-725b-4e19-ac98-d8826a03df51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55552e03-f570-4ef7-b624-83ed029e89a9", "name": "network-vif-deleted", "tag": "410dad97-edfe-4c3c-b0a9-ccea29876b7a"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:56:25.692491 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-84f25c0b-29bc-43d9-bc73-bfa649531cff req-ca2d2acd-725b-4e19-ac98-d8826a03df51 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:25.693465 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-84f25c0b-29bc-43d9-bc73-bfa649531cff req-ca2d2acd-725b-4e19-ac98-d8826a03df51 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:25.704988 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-84f25c0b-29bc-43d9-bc73-bfa649531cff req-ca2d2acd-725b-4e19-ac98-d8826a03df51 service nova] Creating event network-vif-deleted:410dad97-edfe-4c3c-b0a9-ccea29876b7a for instance 55552e03-f570-4ef7-b624-83ed029e89a9 on hv-cinder-83754 Jul 29 11:56:25.711126 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-84f25c0b-29bc-43d9-bc73-bfa649531cff req-ca2d2acd-725b-4e19-ac98-d8826a03df51 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031723 Jul 29 11:56:25.712035 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 438/862] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:56:26.053056 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-58fe5a34-e464-4528-bc18-268dbb5d09ab tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:26.053605 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-58fe5a34-e464-4528-bc18-268dbb5d09ab tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:26.059903 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-58fe5a34-e464-4528-bc18-268dbb5d09ab tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:26.060364 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-58fe5a34-e464-4528-bc18-268dbb5d09ab tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:26.061143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-58fe5a34-e464-4528-bc18-268dbb5d09ab tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:26.061618 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-58fe5a34-e464-4528-bc18-268dbb5d09ab tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:26.095590 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-58fe5a34-e464-4528-bc18-268dbb5d09ab tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:26.096049 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-58fe5a34-e464-4528-bc18-268dbb5d09ab tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:26.096508 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.objects.instance [None req-58fe5a34-e464-4528-bc18-268dbb5d09ab tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lazy-loading 'fault' on Instance uuid 55552e03-f570-4ef7-b624-83ed029e89a9 {{(pid=129585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:56:26.138426 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-58fe5a34-e464-4528-bc18-268dbb5d09ab tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:26.146077 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-58fe5a34-e464-4528-bc18-268dbb5d09ab tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 200 len: 1326 microversion: 2.1 time: 0.097530 Jul 29 11:56:26.147043 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 425/863] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:26 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 1326 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:26.369054 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-db920b90-71f9-4b95-a780-54a91ef2b3a6 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:26.369729 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-db920b90-71f9-4b95-a780-54a91ef2b3a6 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:26.375856 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-db920b90-71f9-4b95-a780-54a91ef2b3a6 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:26.376304 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-db920b90-71f9-4b95-a780-54a91ef2b3a6 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:26.377070 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-db920b90-71f9-4b95-a780-54a91ef2b3a6 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:26.377537 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-db920b90-71f9-4b95-a780-54a91ef2b3a6 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:26.523574 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-db920b90-71f9-4b95-a780-54a91ef2b3a6 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:26.533100 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-db920b90-71f9-4b95-a780-54a91ef2b3a6 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.168846 Jul 29 11:56:26.533728 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 439/864] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:26 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:27.167349 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-43225e4d-f5a2-4b11-96b5-7c6602fc2fd4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:27.167963 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-43225e4d-f5a2-4b11-96b5-7c6602fc2fd4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:27.174539 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-43225e4d-f5a2-4b11-96b5-7c6602fc2fd4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:27.174997 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-43225e4d-f5a2-4b11-96b5-7c6602fc2fd4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:27.175777 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-43225e4d-f5a2-4b11-96b5-7c6602fc2fd4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:27.176223 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-43225e4d-f5a2-4b11-96b5-7c6602fc2fd4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:27.190422 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-43225e4d-f5a2-4b11-96b5-7c6602fc2fd4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] HTTP exception thrown: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-43225e4d-f5a2-4b11-96b5-7c6602fc2fd4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Request method failure captured: Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 HTTP/1.1 Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48o6abnMkKtEAVvCK3Im74o4MsLTntHsNwMRtPNUgtkRuYC8x89no_RL_RQPXKqmEUKCIQdhVB7ZSMj7fO6cFhOhVeooI5tS8ULhEOXAfuKxxIOC-CRJh4J1CoMC5ov9GddnhlVotGafUXNS4E3UEoRp1OINKvy8R83jEE5hUyK04Z8 Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 69ac15e2b1074938adfa7615f1ff1495 Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:56:27.192104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:56:27.194719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_69ac15e2b1074938adfa7615f1ff1495", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:56:27.194719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:56:27.194719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 69ac15e2b1074938adfa7615f1ff1495 Jul 29 11:56:27.194719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:56:27.194719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-AttachVolumeTestJSON-1787130961-project Jul 29 11:56:27.194719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:56:27.194719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:56:27.194719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 20da01b3f86d40cfa84762492eea43f1 Jul 29 11:56:27.194719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-AttachVolumeTestJSON-1787130961-project Jul 29 11:56:27.194719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:56:27.194719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. Jul 29 11:56:27.194719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': '55552e03-f570-4ef7-b624-83ed029e89a9'} Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:56:27.195806 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. Jul 29 11:56:27.197354 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:56:27.198723 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-43225e4d-f5a2-4b11-96b5-7c6602fc2fd4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Returning 404 to user: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:56:27.198723 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-43225e4d-f5a2-4b11-96b5-7c6602fc2fd4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 404 len: 111 microversion: 2.1 time: 0.030818 Jul 29 11:56:27.198723 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 426/865] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:27 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:56:27.203245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d4bbfc68-89dc-450f-9e2c-f0915d5dc026 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '.version_select at 0x7f68f9e2bd30>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:27.221918 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d4bbfc68-89dc-450f-9e2c-f0915d5dc026 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-300045849" status: 202 len: 0 microversion: 2.1 time: 0.022465 Jul 29 11:56:27.222494 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 440/866] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Jul 29 11:56:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-300045849 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:56:27.555274 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a794bb37-3089-42cc-9ab8-1e87c6c39ac3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:27.555888 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a794bb37-3089-42cc-9ab8-1e87c6c39ac3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:27.561976 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a794bb37-3089-42cc-9ab8-1e87c6c39ac3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:27.562428 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a794bb37-3089-42cc-9ab8-1e87c6c39ac3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:27.563362 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a794bb37-3089-42cc-9ab8-1e87c6c39ac3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:27.563805 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a794bb37-3089-42cc-9ab8-1e87c6c39ac3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:27.700361 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a794bb37-3089-42cc-9ab8-1e87c6c39ac3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:27.709099 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a794bb37-3089-42cc-9ab8-1e87c6c39ac3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.157768 Jul 29 11:56:27.709684 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 427/867] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:27 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:27.839716 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d198ae1a-26fc-4d2d-a323-103f807a3e1c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Action: 'create', calling method: .version_select at 0x7f68f9f5c160>, body: {"keypair": {"name": "tempest-keypair-234163251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX6R26DFWJjwrYe85M5F67r7k7T4YFj0ZmTc4//Ss4J3D/lLBvPZ56Xy0YQMdR+ObLWVnBDej0BCa7/j+a8woip38pnXGgcei+COhqC9XzOGeGF6DMNQxlknlQg1vheaA=="}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:56:27.855819 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-d198ae1a-26fc-4d2d-a323-103f807a3e1c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Getting quotas for project 69ac15e2b1074938adfa7615f1ff1495. Resources: {'key_pairs'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:56:27.859753 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-d198ae1a-26fc-4d2d-a323-103f807a3e1c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Getting quotas for user 20da01b3f86d40cfa84762492eea43f1 and project 69ac15e2b1074938adfa7615f1ff1495. Resources: {'key_pairs'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:56:27.882553 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d198ae1a-26fc-4d2d-a323-103f807a3e1c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047627 Jul 29 11:56:27.883158 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 441/868] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Jul 29 11:56:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:56:28.731299 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-832cb404-2fcb-46f7-9dd4-04e7706bd454 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:28.731913 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-832cb404-2fcb-46f7-9dd4-04e7706bd454 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:28.738315 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-832cb404-2fcb-46f7-9dd4-04e7706bd454 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:28.738767 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-832cb404-2fcb-46f7-9dd4-04e7706bd454 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:28.740051 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-832cb404-2fcb-46f7-9dd4-04e7706bd454 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:28.740549 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-832cb404-2fcb-46f7-9dd4-04e7706bd454 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:28.964889 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-832cb404-2fcb-46f7-9dd4-04e7706bd454 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:28.972543 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-832cb404-2fcb-46f7-9dd4-04e7706bd454 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.245141 Jul 29 11:56:28.973117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 428/869] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:28 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:29.232588 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-87bd940d-849a-4b79-87dd-eb66de90e127 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1159640006", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6a7e919-a436-4946-8b78-7a1d701f617b"}], "security_groups": [{"name": "tempest-securitygroup--1891458356"}], "key_name": "tempest-keypair-234163251", "user_data": "}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:56:29.334284 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.network.neutron [None req-87bd940d-849a-4b79-87dd-eb66de90e127 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] validate_networks() for [('b6a7e919-a436-4946-8b78-7a1d701f617b', None, None, None, None, None)] {{(pid=129584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:56:29.703207 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-87bd940d-849a-4b79-87dd-eb66de90e127 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Flavor limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:56:29.703633 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-87bd940d-849a-4b79-87dd-eb66de90e127 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Image limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:56:29.704100 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-87bd940d-849a-4b79-87dd-eb66de90e127 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Flavor pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:56:29.704619 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-87bd940d-849a-4b79-87dd-eb66de90e127 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Image pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:56:29.705036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-87bd940d-849a-4b79-87dd-eb66de90e127 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:56:29.714359 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-87bd940d-849a-4b79-87dd-eb66de90e127 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:29.714806 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-87bd940d-849a-4b79-87dd-eb66de90e127 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:29.715600 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-87bd940d-849a-4b79-87dd-eb66de90e127 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:29.716120 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-87bd940d-849a-4b79-87dd-eb66de90e127 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:29.733341 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-87bd940d-849a-4b79-87dd-eb66de90e127 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Getting quotas for project 69ac15e2b1074938adfa7615f1ff1495. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:56:29.737302 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-87bd940d-849a-4b79-87dd-eb66de90e127 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Getting quotas for user 20da01b3f86d40cfa84762492eea43f1 and project 69ac15e2b1074938adfa7615f1ff1495. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:56:29.748868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-87bd940d-849a-4b79-87dd-eb66de90e127 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Going to run 1 instances... {{(pid=129584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:56:29.751137 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-87bd940d-849a-4b79-87dd-eb66de90e127 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:56:29.797065 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-87bd940d-849a-4b79-87dd-eb66de90e127 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.569154 Jul 29 11:56:29.797756 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 442/870] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:56:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 11:56:29.809519 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-bc218e12-1918-4ddc-bbf6-acc1b02ad737 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:29.810145 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-bc218e12-1918-4ddc-bbf6-acc1b02ad737 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:29.862381 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-bc218e12-1918-4ddc-bbf6-acc1b02ad737 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:29.869852 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-bc218e12-1918-4ddc-bbf6-acc1b02ad737 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1237 microversion: 2.1 time: 0.064216 Jul 29 11:56:29.870441 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 429/871] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:29 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1237 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:29.994981 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-56ae7dcc-6976-4ea3-a66c-bc44128301f4 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:29.995511 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-56ae7dcc-6976-4ea3-a66c-bc44128301f4 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:30.002106 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-56ae7dcc-6976-4ea3-a66c-bc44128301f4 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:30.002554 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-56ae7dcc-6976-4ea3-a66c-bc44128301f4 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:30.003308 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-56ae7dcc-6976-4ea3-a66c-bc44128301f4 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:30.003740 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-56ae7dcc-6976-4ea3-a66c-bc44128301f4 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:30.134100 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-56ae7dcc-6976-4ea3-a66c-bc44128301f4 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:30.141638 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-56ae7dcc-6976-4ea3-a66c-bc44128301f4 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.150617 Jul 29 11:56:30.142225 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 443/872] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:29 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:30.891741 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5692566b-a782-4392-b342-d1d8cefb83c7 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:30.893681 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-5692566b-a782-4392-b342-d1d8cefb83c7 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:30.948509 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-5692566b-a782-4392-b342-d1d8cefb83c7 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:30.955535 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-5692566b-a782-4392-b342-d1d8cefb83c7 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1237 microversion: 2.1 time: 0.068714 Jul 29 11:56:30.956175 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 430/873] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:30 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:31.163915 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-38bcc741-959d-4930-968b-f6cbef0fc615 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:31.164524 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-38bcc741-959d-4930-968b-f6cbef0fc615 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:31.170941 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-38bcc741-959d-4930-968b-f6cbef0fc615 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:31.171389 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-38bcc741-959d-4930-968b-f6cbef0fc615 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:31.172312 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-38bcc741-959d-4930-968b-f6cbef0fc615 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:31.172576 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-38bcc741-959d-4930-968b-f6cbef0fc615 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:31.306693 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-38bcc741-959d-4930-968b-f6cbef0fc615 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:31.314321 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-38bcc741-959d-4930-968b-f6cbef0fc615 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.154958 Jul 29 11:56:31.314892 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 444/874] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:31 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:31.979180 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-26b20fa3-76e8-42b3-bf0c-ffc96384f138 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:31.979793 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-26b20fa3-76e8-42b3-bf0c-ffc96384f138 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:32.032227 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-26b20fa3-76e8-42b3-bf0c-ffc96384f138 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:32.039642 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-26b20fa3-76e8-42b3-bf0c-ffc96384f138 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1237 microversion: 2.1 time: 0.065292 Jul 29 11:56:32.040243 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 431/875] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:31 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:32.336967 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-fb5915f1-5116-49fe-9573-75eb0ea263c7 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:32.337530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-fb5915f1-5116-49fe-9573-75eb0ea263c7 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:32.344149 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fb5915f1-5116-49fe-9573-75eb0ea263c7 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:32.345334 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fb5915f1-5116-49fe-9573-75eb0ea263c7 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:32.346258 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fb5915f1-5116-49fe-9573-75eb0ea263c7 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:32.347132 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fb5915f1-5116-49fe-9573-75eb0ea263c7 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:32.482557 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-fb5915f1-5116-49fe-9573-75eb0ea263c7 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:32.490937 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-fb5915f1-5116-49fe-9573-75eb0ea263c7 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.158679 Jul 29 11:56:32.491501 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 445/876] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:32 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:33.060035 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-277b4aec-5a18-4674-befd-eef229083371 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:33.060659 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-277b4aec-5a18-4674-befd-eef229083371 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:33.115564 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-277b4aec-5a18-4674-befd-eef229083371 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:33.122975 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-277b4aec-5a18-4674-befd-eef229083371 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1237 microversion: 2.1 time: 0.066742 Jul 29 11:56:33.123535 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 432/877] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:33 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:33.511917 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-837d8899-c32f-44a0-95f1-c9f88cb33be1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:33.512534 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-837d8899-c32f-44a0-95f1-c9f88cb33be1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:33.518970 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-837d8899-c32f-44a0-95f1-c9f88cb33be1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:33.519368 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-837d8899-c32f-44a0-95f1-c9f88cb33be1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:33.520134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-837d8899-c32f-44a0-95f1-c9f88cb33be1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:33.520759 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-837d8899-c32f-44a0-95f1-c9f88cb33be1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:33.658102 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-837d8899-c32f-44a0-95f1-c9f88cb33be1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:33.666295 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-837d8899-c32f-44a0-95f1-c9f88cb33be1 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.158425 Jul 29 11:56:33.666849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 446/878] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:33 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:34.144183 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6612f44b-0545-4c25-97d7-847c22a4947b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:34.144724 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6612f44b-0545-4c25-97d7-847c22a4947b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:34.151755 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6612f44b-0545-4c25-97d7-847c22a4947b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:34.152211 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6612f44b-0545-4c25-97d7-847c22a4947b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:34.153007 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6612f44b-0545-4c25-97d7-847c22a4947b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:34.153480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6612f44b-0545-4c25-97d7-847c22a4947b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:34.214313 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6612f44b-0545-4c25-97d7-847c22a4947b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:34.221677 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6612f44b-0545-4c25-97d7-847c22a4947b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1241 microversion: 2.1 time: 0.081422 Jul 29 11:56:34.222253 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 433/879] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:34 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:34.688134 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-45bdbecd-789c-412a-b619-420d26ca8f3b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:34.688743 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-45bdbecd-789c-412a-b619-420d26ca8f3b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:34.695376 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-45bdbecd-789c-412a-b619-420d26ca8f3b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:34.695829 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-45bdbecd-789c-412a-b619-420d26ca8f3b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:34.696593 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-45bdbecd-789c-412a-b619-420d26ca8f3b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:34.697033 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-45bdbecd-789c-412a-b619-420d26ca8f3b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:34.838688 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-45bdbecd-789c-412a-b619-420d26ca8f3b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:34.847183 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-45bdbecd-789c-412a-b619-420d26ca8f3b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1508 microversion: 2.1 time: 0.162853 Jul 29 11:56:34.849452 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 447/880] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:34 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:34.869381 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8f73822c-7e1d-400e-b9d9-611024d087fd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:56:34.870484 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8f73822c-7e1d-400e-b9d9-611024d087fd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:34.876795 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8f73822c-7e1d-400e-b9d9-611024d087fd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:34.877473 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8f73822c-7e1d-400e-b9d9-611024d087fd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:34.878454 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8f73822c-7e1d-400e-b9d9-611024d087fd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:34.878890 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8f73822c-7e1d-400e-b9d9-611024d087fd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:34.885050 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:56:34.913078 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8f73822c-7e1d-400e-b9d9-611024d087fd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129585) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 11:56:34.982156 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8f73822c-7e1d-400e-b9d9-611024d087fd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [a9bc76b1-ca3f-4bbe-93d2-b2139ed46afb] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 11:56:35.242456 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-bbb412ac-85e4-4697-b44d-c4ca07926131 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:35.243204 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-bbb412ac-85e4-4697-b44d-c4ca07926131 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:35.249095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bbb412ac-85e4-4697-b44d-c4ca07926131 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:35.249585 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bbb412ac-85e4-4697-b44d-c4ca07926131 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:35.250357 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bbb412ac-85e4-4697-b44d-c4ca07926131 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:35.250798 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bbb412ac-85e4-4697-b44d-c4ca07926131 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:35.313038 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bbb412ac-85e4-4697-b44d-c4ca07926131 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:35.321567 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-bbb412ac-85e4-4697-b44d-c4ca07926131 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1295 microversion: 2.1 time: 0.083025 Jul 29 11:56:35.322374 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 448/881] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:35 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1295 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:56:35.988974 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO oslo.messaging._drivers.impl_rabbit [None req-8f73822c-7e1d-400e-b9d9-611024d087fd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [a9bc76b1-ca3f-4bbe-93d2-b2139ed46afb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 46608. Jul 29 11:56:35.993293 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8f73822c-7e1d-400e-b9d9-611024d087fd tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "POST /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6/action" status: 202 len: 0 microversion: 2.1 time: 1.128848 Jul 29 11:56:35.994177 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 434/882] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Jul 29 11:56:34 2022] POST /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6/action => generated 0 bytes in 1130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:56:36.003177 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-0da7cc45-f4c2-4dce-9907-b3125bc918d9 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:36.004132 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-0da7cc45-f4c2-4dce-9907-b3125bc918d9 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:36.010994 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0da7cc45-f4c2-4dce-9907-b3125bc918d9 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:36.011662 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0da7cc45-f4c2-4dce-9907-b3125bc918d9 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:36.012601 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0da7cc45-f4c2-4dce-9907-b3125bc918d9 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:36.013050 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0da7cc45-f4c2-4dce-9907-b3125bc918d9 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:36.181987 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-0da7cc45-f4c2-4dce-9907-b3125bc918d9 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:36.196868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-0da7cc45-f4c2-4dce-9907-b3125bc918d9 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1516 microversion: 2.1 time: 0.198221 Jul 29 11:56:36.197471 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 449/883] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:35 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:56:36.330656 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-ba6946cb-f63d-45cd-bd0b-5ba1a606cb64 req-df586e21-f800-476b-aee0-cb6555d51c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b3bd77-c09f-4ae4-a164-82b13b989b64", "tag": "15e92700-4198-47fc-8f8b-722dab6409f4"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:56:36.344163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-04c27d4a-8c86-4607-84b6-e2396793c528 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:36.345355 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-04c27d4a-8c86-4607-84b6-e2396793c528 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:36.345547 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-ba6946cb-f63d-45cd-bd0b-5ba1a606cb64 req-df586e21-f800-476b-aee0-cb6555d51c20 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:36.346618 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-ba6946cb-f63d-45cd-bd0b-5ba1a606cb64 req-df586e21-f800-476b-aee0-cb6555d51c20 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:36.356246 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-04c27d4a-8c86-4607-84b6-e2396793c528 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:36.356715 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-04c27d4a-8c86-4607-84b6-e2396793c528 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:36.358544 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-ba6946cb-f63d-45cd-bd0b-5ba1a606cb64 req-df586e21-f800-476b-aee0-cb6555d51c20 service nova] Creating event network-changed:15e92700-4198-47fc-8f8b-722dab6409f4 for instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 on hv-cinder-83754 Jul 29 11:56:36.359281 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-04c27d4a-8c86-4607-84b6-e2396793c528 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:36.359756 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-04c27d4a-8c86-4607-84b6-e2396793c528 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:36.367965 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-ba6946cb-f63d-45cd-bd0b-5ba1a606cb64 req-df586e21-f800-476b-aee0-cb6555d51c20 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041601 Jul 29 11:56:36.369148 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 435/884] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:56:36.546100 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-04c27d4a-8c86-4607-84b6-e2396793c528 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:36.550261 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=100 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:56:36.555691 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-04c27d4a-8c86-4607-84b6-e2396793c528 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1363 microversion: 2.1 time: 0.216499 Jul 29 11:56:36.556271 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 450/885] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:36 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:36.684229 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-0b4d9725-b263-4db9-bd90-d187b3adaade req-865d4a73-b1f3-46bc-88e5-d23ccbf3d1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ff3352-15b3-4066-b66b-fe3e5c4ff2d6", "name": "network-vif-unplugged", "status": "completed", "tag": "7db84d29-10d0-41a8-abf4-9bb896740271"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:56:36.703178 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-0b4d9725-b263-4db9-bd90-d187b3adaade req-865d4a73-b1f3-46bc-88e5-d23ccbf3d1a4 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:36.703863 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-0b4d9725-b263-4db9-bd90-d187b3adaade req-865d4a73-b1f3-46bc-88e5-d23ccbf3d1a4 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:36.731321 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.compute.server_external_events [req-0b4d9725-b263-4db9-bd90-d187b3adaade req-865d4a73-b1f3-46bc-88e5-d23ccbf3d1a4 service nova] Unable to find a host for instance 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6. Dropping event network-vif-unplugged {{(pid=129585) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 29 11:56:36.732242 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-0b4d9725-b263-4db9-bd90-d187b3adaade req-865d4a73-b1f3-46bc-88e5-d23ccbf3d1a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.052531 Jul 29 11:56:36.733410 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 436/886] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 29 11:56:37.218351 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-8eec1290-830a-4f8d-94ed-d6416a92065b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:37.218965 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-8eec1290-830a-4f8d-94ed-d6416a92065b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:37.226097 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8eec1290-830a-4f8d-94ed-d6416a92065b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:37.226548 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8eec1290-830a-4f8d-94ed-d6416a92065b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:37.227305 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8eec1290-830a-4f8d-94ed-d6416a92065b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:37.227740 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8eec1290-830a-4f8d-94ed-d6416a92065b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:37.356821 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-8eec1290-830a-4f8d-94ed-d6416a92065b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:37.364361 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-8eec1290-830a-4f8d-94ed-d6416a92065b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1518 microversion: 2.1 time: 0.149742 Jul 29 11:56:37.364926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 451/887] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:37 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:37.576160 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-84a9e335-55c1-4cdd-a6d1-aa208976bf6c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:37.576921 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-84a9e335-55c1-4cdd-a6d1-aa208976bf6c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:37.584508 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-84a9e335-55c1-4cdd-a6d1-aa208976bf6c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:37.584967 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-84a9e335-55c1-4cdd-a6d1-aa208976bf6c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:37.585775 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-84a9e335-55c1-4cdd-a6d1-aa208976bf6c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:37.586214 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-84a9e335-55c1-4cdd-a6d1-aa208976bf6c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:37.714469 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-84a9e335-55c1-4cdd-a6d1-aa208976bf6c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:37.721983 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-84a9e335-55c1-4cdd-a6d1-aa208976bf6c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1363 microversion: 2.1 time: 0.149757 Jul 29 11:56:37.722539 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 437/888] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:37 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:38.386420 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-f424e576-d981-4549-8f6b-7d10ef0cd00f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:38.387037 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-f424e576-d981-4549-8f6b-7d10ef0cd00f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:38.393681 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f424e576-d981-4549-8f6b-7d10ef0cd00f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:38.394136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f424e576-d981-4549-8f6b-7d10ef0cd00f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:38.395218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f424e576-d981-4549-8f6b-7d10ef0cd00f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:38.395799 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-f424e576-d981-4549-8f6b-7d10ef0cd00f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:38.528442 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-f424e576-d981-4549-8f6b-7d10ef0cd00f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:38.536104 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-f424e576-d981-4549-8f6b-7d10ef0cd00f tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1574 microversion: 2.1 time: 0.153799 Jul 29 11:56:38.536687 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 452/889] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:38 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:38.741998 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-7d044939-a492-43f2-8d80-7278b37906ee tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:38.742630 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-7d044939-a492-43f2-8d80-7278b37906ee tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:38.749287 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7d044939-a492-43f2-8d80-7278b37906ee tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:38.749965 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7d044939-a492-43f2-8d80-7278b37906ee tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:38.752802 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7d044939-a492-43f2-8d80-7278b37906ee tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:38.752802 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7d044939-a492-43f2-8d80-7278b37906ee tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:38.889865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-7d044939-a492-43f2-8d80-7278b37906ee tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:38.898335 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-7d044939-a492-43f2-8d80-7278b37906ee tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1363 microversion: 2.1 time: 0.160183 Jul 29 11:56:38.898913 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 438/890] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:38 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:39.557342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d94fc39e-5fa5-4392-94a3-0d5a1cc8aa79 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:39.557942 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d94fc39e-5fa5-4392-94a3-0d5a1cc8aa79 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:39.564509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d94fc39e-5fa5-4392-94a3-0d5a1cc8aa79 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:39.564960 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d94fc39e-5fa5-4392-94a3-0d5a1cc8aa79 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:39.565897 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d94fc39e-5fa5-4392-94a3-0d5a1cc8aa79 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:39.566366 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d94fc39e-5fa5-4392-94a3-0d5a1cc8aa79 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:39.708835 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d94fc39e-5fa5-4392-94a3-0d5a1cc8aa79 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:39.720435 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d94fc39e-5fa5-4392-94a3-0d5a1cc8aa79 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1574 microversion: 2.1 time: 0.166961 Jul 29 11:56:39.721285 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 453/891] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:39 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:39.919145 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a4865888-a4c3-41d7-8905-3b8ddd9bfd00 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:39.919666 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a4865888-a4c3-41d7-8905-3b8ddd9bfd00 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:39.926297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a4865888-a4c3-41d7-8905-3b8ddd9bfd00 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:39.926919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a4865888-a4c3-41d7-8905-3b8ddd9bfd00 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:39.927697 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a4865888-a4c3-41d7-8905-3b8ddd9bfd00 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:39.928139 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a4865888-a4c3-41d7-8905-3b8ddd9bfd00 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:40.058862 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a4865888-a4c3-41d7-8905-3b8ddd9bfd00 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:40.066228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a4865888-a4c3-41d7-8905-3b8ddd9bfd00 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1363 microversion: 2.1 time: 0.151056 Jul 29 11:56:40.066790 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 439/892] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:39 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:40.743234 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-94e6807f-e56a-4818-856e-9543c4e9ad01 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:40.743856 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-94e6807f-e56a-4818-856e-9543c4e9ad01 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:40.745770 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=2 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:56:40.746558 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=10 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:56:40.752369 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-94e6807f-e56a-4818-856e-9543c4e9ad01 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:40.752819 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-94e6807f-e56a-4818-856e-9543c4e9ad01 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:40.753632 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-94e6807f-e56a-4818-856e-9543c4e9ad01 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:40.754068 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-94e6807f-e56a-4818-856e-9543c4e9ad01 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:40.886353 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-94e6807f-e56a-4818-856e-9543c4e9ad01 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:40.893898 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-94e6807f-e56a-4818-856e-9543c4e9ad01 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1574 microversion: 2.1 time: 0.155230 Jul 29 11:56:40.894468 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 454/893] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:40 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:41.087945 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-bb346b9a-16a0-496b-ada2-a4aa97826bbc tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:41.088570 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-bb346b9a-16a0-496b-ada2-a4aa97826bbc tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:41.094615 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bb346b9a-16a0-496b-ada2-a4aa97826bbc tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:41.095069 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bb346b9a-16a0-496b-ada2-a4aa97826bbc tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:41.095843 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bb346b9a-16a0-496b-ada2-a4aa97826bbc tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:41.096282 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bb346b9a-16a0-496b-ada2-a4aa97826bbc tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:41.241346 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-bb346b9a-16a0-496b-ada2-a4aa97826bbc tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:41.248809 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-bb346b9a-16a0-496b-ada2-a4aa97826bbc tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1363 microversion: 2.1 time: 0.164949 Jul 29 11:56:41.249372 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 440/894] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:41 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:56:41.915062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-047d8f1d-3c89-4c10-b995-5942c13fc222 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:41.915675 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-047d8f1d-3c89-4c10-b995-5942c13fc222 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:41.922118 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-047d8f1d-3c89-4c10-b995-5942c13fc222 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:41.922565 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-047d8f1d-3c89-4c10-b995-5942c13fc222 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:41.923315 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-047d8f1d-3c89-4c10-b995-5942c13fc222 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:41.923745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-047d8f1d-3c89-4c10-b995-5942c13fc222 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:42.054847 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-047d8f1d-3c89-4c10-b995-5942c13fc222 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:42.062332 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-047d8f1d-3c89-4c10-b995-5942c13fc222 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1574 microversion: 2.1 time: 0.151455 Jul 29 11:56:42.062886 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 455/895] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:41 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:42.269715 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-406efd0c-9b71-477e-b16c-680eb53fd783 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:42.270342 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-406efd0c-9b71-477e-b16c-680eb53fd783 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:42.277083 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-406efd0c-9b71-477e-b16c-680eb53fd783 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:42.277584 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-406efd0c-9b71-477e-b16c-680eb53fd783 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:42.278358 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-406efd0c-9b71-477e-b16c-680eb53fd783 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:42.278801 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-406efd0c-9b71-477e-b16c-680eb53fd783 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:42.406719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-406efd0c-9b71-477e-b16c-680eb53fd783 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:42.414558 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-406efd0c-9b71-477e-b16c-680eb53fd783 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1363 microversion: 2.1 time: 0.148755 Jul 29 11:56:42.415116 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 441/896] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:42 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:42.725718 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-c23edd67-c17b-4a75-adf0-dd9fc8bf3738 req-2c75f400-b09f-46dc-94a6-b3b083a90d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b3bd77-c09f-4ae4-a164-82b13b989b64", "name": "network-vif-plugged", "status": "completed", "tag": "15e92700-4198-47fc-8f8b-722dab6409f4"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:56:42.736004 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-c23edd67-c17b-4a75-adf0-dd9fc8bf3738 req-2c75f400-b09f-46dc-94a6-b3b083a90d27 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:42.736459 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-c23edd67-c17b-4a75-adf0-dd9fc8bf3738 req-2c75f400-b09f-46dc-94a6-b3b083a90d27 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:42.748238 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-c23edd67-c17b-4a75-adf0-dd9fc8bf3738 req-2c75f400-b09f-46dc-94a6-b3b083a90d27 service nova] Creating event network-vif-plugged:15e92700-4198-47fc-8f8b-722dab6409f4 for instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 on hv-cinder-83754 Jul 29 11:56:42.753137 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-c23edd67-c17b-4a75-adf0-dd9fc8bf3738 req-2c75f400-b09f-46dc-94a6-b3b083a90d27 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031806 Jul 29 11:56:42.753762 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 456/897] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:56:43.084493 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8e4c39d0-155d-4cad-a8cb-16bb1142194b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:43.085110 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8e4c39d0-155d-4cad-a8cb-16bb1142194b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:43.091219 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8e4c39d0-155d-4cad-a8cb-16bb1142194b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:43.091674 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8e4c39d0-155d-4cad-a8cb-16bb1142194b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:43.092446 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8e4c39d0-155d-4cad-a8cb-16bb1142194b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:43.092887 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8e4c39d0-155d-4cad-a8cb-16bb1142194b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:43.124334 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=8 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:56:43.436083 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ea427c83-4caa-4893-900e-3e3193bdb431 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:43.436788 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ea427c83-4caa-4893-900e-3e3193bdb431 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:43.443221 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ea427c83-4caa-4893-900e-3e3193bdb431 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:43.443611 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ea427c83-4caa-4893-900e-3e3193bdb431 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:43.444379 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ea427c83-4caa-4893-900e-3e3193bdb431 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:43.444850 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ea427c83-4caa-4893-900e-3e3193bdb431 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:43.495429 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-8e4c39d0-155d-4cad-a8cb-16bb1142194b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:43.503120 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8e4c39d0-155d-4cad-a8cb-16bb1142194b tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1574 microversion: 2.1 time: 0.423201 Jul 29 11:56:43.503695 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 442/898] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:43 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1574 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:43.575545 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ea427c83-4caa-4893-900e-3e3193bdb431 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:43.583648 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ea427c83-4caa-4893-900e-3e3193bdb431 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1363 microversion: 2.1 time: 0.151658 Jul 29 11:56:43.584208 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 457/899] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:43 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:56:44.524505 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-bae48009-99e6-41d2-8d91-27e2c8f1f97e tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:44.525128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-bae48009-99e6-41d2-8d91-27e2c8f1f97e tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:44.531860 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bae48009-99e6-41d2-8d91-27e2c8f1f97e tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:44.532321 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bae48009-99e6-41d2-8d91-27e2c8f1f97e tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:44.533156 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bae48009-99e6-41d2-8d91-27e2c8f1f97e tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:44.533798 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-bae48009-99e6-41d2-8d91-27e2c8f1f97e tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:44.605250 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-0adfc753-b8a7-437a-be93-083a62766010 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:44.605900 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-0adfc753-b8a7-437a-be93-083a62766010 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:44.612429 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0adfc753-b8a7-437a-be93-083a62766010 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:44.612888 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0adfc753-b8a7-437a-be93-083a62766010 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:44.613688 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0adfc753-b8a7-437a-be93-083a62766010 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:44.614792 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0adfc753-b8a7-437a-be93-083a62766010 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:44.702312 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-bae48009-99e6-41d2-8d91-27e2c8f1f97e tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:44.711040 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-bae48009-99e6-41d2-8d91-27e2c8f1f97e tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1574 microversion: 2.1 time: 0.190655 Jul 29 11:56:44.711611 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 443/900] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:44 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:44.765452 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-0adfc753-b8a7-437a-be93-083a62766010 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:44.773607 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-0adfc753-b8a7-437a-be93-083a62766010 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1550 microversion: 2.1 time: 0.172393 Jul 29 11:56:44.774175 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 458/901] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:44 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1550 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:44.794136 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-09b95c2b-c128-4566-aa1a-f1331c19500c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:44.794637 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-09b95c2b-c128-4566-aa1a-f1331c19500c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:44.800587 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-09b95c2b-c128-4566-aa1a-f1331c19500c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:44.801046 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-09b95c2b-c128-4566-aa1a-f1331c19500c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:44.801950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-09b95c2b-c128-4566-aa1a-f1331c19500c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:44.802394 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-09b95c2b-c128-4566-aa1a-f1331c19500c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:44.878139 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-09b95c2b-c128-4566-aa1a-f1331c19500c tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087772 Jul 29 11:56:44.878747 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 444/902] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Jul 29 11:56:44 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:56:45.732638 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-82d50b98-aa2b-41b2-8ea5-80f48f6a0a82 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:45.733961 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-82d50b98-aa2b-41b2-8ea5-80f48f6a0a82 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:45.736410 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:56:45.744065 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-82d50b98-aa2b-41b2-8ea5-80f48f6a0a82 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:45.744488 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-82d50b98-aa2b-41b2-8ea5-80f48f6a0a82 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:45.745290 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-82d50b98-aa2b-41b2-8ea5-80f48f6a0a82 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:45.745753 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-82d50b98-aa2b-41b2-8ea5-80f48f6a0a82 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:45.801904 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-2786de68-48a1-4ea3-afa3-0b3ecf1ce482 req-8e7b82ca-d117-4067-b302-03c375c94be1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b3bd77-c09f-4ae4-a164-82b13b989b64", "tag": "15e92700-4198-47fc-8f8b-722dab6409f4"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:56:45.807647 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:56:45.815487 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-2786de68-48a1-4ea3-afa3-0b3ecf1ce482 req-8e7b82ca-d117-4067-b302-03c375c94be1 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:45.816248 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-2786de68-48a1-4ea3-afa3-0b3ecf1ce482 req-8e7b82ca-d117-4067-b302-03c375c94be1 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:45.829115 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-2786de68-48a1-4ea3-afa3-0b3ecf1ce482 req-8e7b82ca-d117-4067-b302-03c375c94be1 service nova] Creating event network-changed:15e92700-4198-47fc-8f8b-722dab6409f4 for instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 on hv-cinder-83754 Jul 29 11:56:45.834960 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-2786de68-48a1-4ea3-afa3-0b3ecf1ce482 req-8e7b82ca-d117-4067-b302-03c375c94be1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036802 Jul 29 11:56:45.835568 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 445/903] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:56:45.919314 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-82d50b98-aa2b-41b2-8ea5-80f48f6a0a82 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:45.928738 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-82d50b98-aa2b-41b2-8ea5-80f48f6a0a82 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1574 microversion: 2.1 time: 0.199935 Jul 29 11:56:45.929322 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 459/904] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:45 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1574 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:46.950515 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-2def6ef6-cc67-4b5d-869e-bb04767ac24c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:46.951428 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-2def6ef6-cc67-4b5d-869e-bb04767ac24c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:46.960047 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2def6ef6-cc67-4b5d-869e-bb04767ac24c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:46.961071 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2def6ef6-cc67-4b5d-869e-bb04767ac24c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:46.962163 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2def6ef6-cc67-4b5d-869e-bb04767ac24c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:46.962601 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2def6ef6-cc67-4b5d-869e-bb04767ac24c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:47.095932 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-2def6ef6-cc67-4b5d-869e-bb04767ac24c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:47.103932 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-2def6ef6-cc67-4b5d-869e-bb04767ac24c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1574 microversion: 2.1 time: 0.158154 Jul 29 11:56:47.104505 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 446/905] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:46 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:48.125025 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b4c2a2d8-8ce4-4660-ae7e-7717c751a60d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:48.125600 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b4c2a2d8-8ce4-4660-ae7e-7717c751a60d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:48.132362 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b4c2a2d8-8ce4-4660-ae7e-7717c751a60d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:48.132822 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b4c2a2d8-8ce4-4660-ae7e-7717c751a60d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:48.133629 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b4c2a2d8-8ce4-4660-ae7e-7717c751a60d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:48.134327 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b4c2a2d8-8ce4-4660-ae7e-7717c751a60d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:48.263740 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b4c2a2d8-8ce4-4660-ae7e-7717c751a60d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:48.271842 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b4c2a2d8-8ce4-4660-ae7e-7717c751a60d tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1574 microversion: 2.1 time: 0.150906 Jul 29 11:56:48.272399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 460/906] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:48 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:48.767373 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-22aeadb3-b7b3-41fe-b2f2-244de6382c86 req-41b9fc00-b455-48d1-bad7-d416e8e2c02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ff3352-15b3-4066-b66b-fe3e5c4ff2d6", "name": "network-vif-plugged", "status": "completed", "tag": "7db84d29-10d0-41a8-abf4-9bb896740271"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:56:48.778207 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-22aeadb3-b7b3-41fe-b2f2-244de6382c86 req-41b9fc00-b455-48d1-bad7-d416e8e2c02e service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:48.778650 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-22aeadb3-b7b3-41fe-b2f2-244de6382c86 req-41b9fc00-b455-48d1-bad7-d416e8e2c02e service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:48.790100 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-22aeadb3-b7b3-41fe-b2f2-244de6382c86 req-41b9fc00-b455-48d1-bad7-d416e8e2c02e service nova] Creating event network-vif-plugged:7db84d29-10d0-41a8-abf4-9bb896740271 for instance 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 on hv-cinder-83754 Jul 29 11:56:48.794998 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-22aeadb3-b7b3-41fe-b2f2-244de6382c86 req-41b9fc00-b455-48d1-bad7-d416e8e2c02e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031384 Jul 29 11:56:48.795764 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 447/907] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:56:49.292843 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-899f1319-c669-42ce-a4c4-c512251c0f00 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:49.293516 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-899f1319-c669-42ce-a4c4-c512251c0f00 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:49.305641 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-899f1319-c669-42ce-a4c4-c512251c0f00 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:49.306485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-899f1319-c669-42ce-a4c4-c512251c0f00 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:49.307902 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-899f1319-c669-42ce-a4c4-c512251c0f00 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:49.308727 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-899f1319-c669-42ce-a4c4-c512251c0f00 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:49.446166 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-899f1319-c669-42ce-a4c4-c512251c0f00 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:49.453632 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-899f1319-c669-42ce-a4c4-c512251c0f00 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1574 microversion: 2.1 time: 0.164709 Jul 29 11:56:49.454191 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 461/908] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:49 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:56:50.476486 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-fe13d842-6400-4063-8c55-dc91e6fd17ea tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:56:50.477105 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-fe13d842-6400-4063-8c55-dc91e6fd17ea tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:56:50.483475 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fe13d842-6400-4063-8c55-dc91e6fd17ea tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:50.483928 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fe13d842-6400-4063-8c55-dc91e6fd17ea tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:50.484690 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fe13d842-6400-4063-8c55-dc91e6fd17ea tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:56:50.485122 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-fe13d842-6400-4063-8c55-dc91e6fd17ea tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:56:50.618333 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-fe13d842-6400-4063-8c55-dc91e6fd17ea tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:56:50.625940 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-fe13d842-6400-4063-8c55-dc91e6fd17ea tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1561 microversion: 2.1 time: 0.154988 Jul 29 11:56:50.626512 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 448/909] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:56:50 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:57:21.969317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-adbd617a-80c8-4281-ba35-9576ca1a723e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:21.969951 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-adbd617a-80c8-4281-ba35-9576ca1a723e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:21.972006 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=5 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:57:21.972651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=62 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:57:21.978508 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-adbd617a-80c8-4281-ba35-9576ca1a723e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:21.978958 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-adbd617a-80c8-4281-ba35-9576ca1a723e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:21.979724 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-adbd617a-80c8-4281-ba35-9576ca1a723e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:21.980153 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-adbd617a-80c8-4281-ba35-9576ca1a723e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:22.003286 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-adbd617a-80c8-4281-ba35-9576ca1a723e tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/ips" status: 200 len: 146 microversion: 2.1 time: 0.037868 Jul 29 11:57:22.003833 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 462/910] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Jul 29 11:57:21 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:57:23.330388 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-97ce87f1-b8c0-4569-8fdf-588b01ec9b6f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bde8ca47-e69d-4161-bb37-6b991ad8cad7"}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:57:23.332692 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-97ce87f1-b8c0-4569-8fdf-588b01ec9b6f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:23.335150 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=7 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:57:23.335795 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:57:23.341357 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-97ce87f1-b8c0-4569-8fdf-588b01ec9b6f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:23.341836 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-97ce87f1-b8c0-4569-8fdf-588b01ec9b6f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:23.342602 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-97ce87f1-b8c0-4569-8fdf-588b01ec9b6f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:23.343035 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-97ce87f1-b8c0-4569-8fdf-588b01ec9b6f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:23.576288 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-97ce87f1-b8c0-4569-8fdf-588b01ec9b6f tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "POST /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249627 Jul 29 11:57:23.576886 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 449/911] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Jul 29 11:57:23 2022] POST /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:57:31.100115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6def971b-98c2-46e1-848c-239d41183813 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:31.102426 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6def971b-98c2-46e1-848c-239d41183813 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:31.108801 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6def971b-98c2-46e1-848c-239d41183813 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:31.109248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6def971b-98c2-46e1-848c-239d41183813 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:31.110043 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6def971b-98c2-46e1-848c-239d41183813 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:31.110474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6def971b-98c2-46e1-848c-239d41183813 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:31.139902 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-6def971b-98c2-46e1-848c-239d41183813 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043831 Jul 29 11:57:31.140442 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 463/912] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:57:31 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:57:31.152210 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-1c07c0a0-cca8-48eb-9a5a-bb872cb25361 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:31.152818 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-1c07c0a0-cca8-48eb-9a5a-bb872cb25361 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:31.159054 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1c07c0a0-cca8-48eb-9a5a-bb872cb25361 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:31.159510 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1c07c0a0-cca8-48eb-9a5a-bb872cb25361 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:31.160279 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1c07c0a0-cca8-48eb-9a5a-bb872cb25361 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:31.160721 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1c07c0a0-cca8-48eb-9a5a-bb872cb25361 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:31.190298 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-1c07c0a0-cca8-48eb-9a5a-bb872cb25361 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments/bde8ca47-e69d-4161-bb37-6b991ad8cad7" status: 200 len: 194 microversion: 2.1 time: 0.043117 Jul 29 11:57:31.190897 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 450/913] 10.222.0.60 () {58 vars in 1413 bytes} [Fri Jul 29 11:57:31 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments/bde8ca47-e69d-4161-bb37-6b991ad8cad7 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:57:32.522709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-dd028106-dee6-4633-be53-165f84426577 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d887d8e-1441-4b54-b841-6b3d8ec0cb66"}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:57:32.525104 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-dd028106-dee6-4633-be53-165f84426577 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:32.531674 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dd028106-dee6-4633-be53-165f84426577 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:32.532120 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dd028106-dee6-4633-be53-165f84426577 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:32.532875 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dd028106-dee6-4633-be53-165f84426577 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:32.533310 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-dd028106-dee6-4633-be53-165f84426577 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:32.771449 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-dd028106-dee6-4633-be53-165f84426577 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "POST /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252630 Jul 29 11:57:32.772601 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 464/914] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Jul 29 11:57:32 2022] POST /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:57:40.286456 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8d317e99-4ef5-423d-8a8e-ae78b99ea0d1 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:40.289239 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8d317e99-4ef5-423d-8a8e-ae78b99ea0d1 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:40.295808 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8d317e99-4ef5-423d-8a8e-ae78b99ea0d1 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:40.296263 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8d317e99-4ef5-423d-8a8e-ae78b99ea0d1 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:40.297034 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8d317e99-4ef5-423d-8a8e-ae78b99ea0d1 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:40.297502 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8d317e99-4ef5-423d-8a8e-ae78b99ea0d1 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:40.328372 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8d317e99-4ef5-423d-8a8e-ae78b99ea0d1 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045831 Jul 29 11:57:40.328921 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 451/915] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:57:40 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:57:40.491087 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-cd9ffbb2-38ed-486b-bcab-9be603aa4749 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:40.491817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-cd9ffbb2-38ed-486b-bcab-9be603aa4749 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:40.498157 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cd9ffbb2-38ed-486b-bcab-9be603aa4749 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:40.498614 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cd9ffbb2-38ed-486b-bcab-9be603aa4749 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:40.499384 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cd9ffbb2-38ed-486b-bcab-9be603aa4749 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:40.499827 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cd9ffbb2-38ed-486b-bcab-9be603aa4749 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:40.528379 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-cd9ffbb2-38ed-486b-bcab-9be603aa4749 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments/bde8ca47-e69d-4161-bb37-6b991ad8cad7" status: 200 len: 194 microversion: 2.1 time: 0.044068 Jul 29 11:57:40.528948 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 465/916] 10.222.0.60 () {58 vars in 1413 bytes} [Fri Jul 29 11:57:40 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments/bde8ca47-e69d-4161-bb37-6b991ad8cad7 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:57:40.539775 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e6c564a7-97b7-4b2a-9835-030e37972af7 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:40.540276 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e6c564a7-97b7-4b2a-9835-030e37972af7 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:40.546251 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e6c564a7-97b7-4b2a-9835-030e37972af7 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:40.546761 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e6c564a7-97b7-4b2a-9835-030e37972af7 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:40.547561 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e6c564a7-97b7-4b2a-9835-030e37972af7 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:40.548005 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e6c564a7-97b7-4b2a-9835-030e37972af7 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:40.626604 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.objects.instance [None req-e6c564a7-97b7-4b2a-9835-030e37972af7 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lazy-loading 'services' on Instance uuid c6b3bd77-c09f-4ae4-a164-82b13b989b64 {{(pid=129585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:57:40.697468 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e6c564a7-97b7-4b2a-9835-030e37972af7 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments/bde8ca47-e69d-4161-bb37-6b991ad8cad7" status: 202 len: 0 microversion: 2.1 time: 0.162168 Jul 29 11:57:40.698051 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 452/917] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Jul 29 11:57:40 2022] DELETE /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments/bde8ca47-e69d-4161-bb37-6b991ad8cad7 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:57:41.819604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-27de9968-9165-45a2-828c-f55a388e0fb8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:41.820865 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-27de9968-9165-45a2-828c-f55a388e0fb8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:41.827313 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-27de9968-9165-45a2-828c-f55a388e0fb8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:41.827786 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-27de9968-9165-45a2-828c-f55a388e0fb8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:41.828544 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-27de9968-9165-45a2-828c-f55a388e0fb8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:41.828985 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-27de9968-9165-45a2-828c-f55a388e0fb8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:41.857943 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-27de9968-9165-45a2-828c-f55a388e0fb8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments/4d887d8e-1441-4b54-b841-6b3d8ec0cb66" status: 200 len: 194 microversion: 2.1 time: 0.042308 Jul 29 11:57:41.858527 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 466/918] 10.222.0.60 () {58 vars in 1413 bytes} [Fri Jul 29 11:57:41 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments/4d887d8e-1441-4b54-b841-6b3d8ec0cb66 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:57:41.870204 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-b5339e17-32a4-4ae8-8550-2ec0cea80e59 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:41.870786 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-b5339e17-32a4-4ae8-8550-2ec0cea80e59 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:41.876934 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b5339e17-32a4-4ae8-8550-2ec0cea80e59 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:41.877389 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b5339e17-32a4-4ae8-8550-2ec0cea80e59 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:41.878183 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b5339e17-32a4-4ae8-8550-2ec0cea80e59 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:41.878624 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b5339e17-32a4-4ae8-8550-2ec0cea80e59 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:41.961190 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.objects.instance [None req-b5339e17-32a4-4ae8-8550-2ec0cea80e59 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lazy-loading 'services' on Instance uuid c6b3bd77-c09f-4ae4-a164-82b13b989b64 {{(pid=129585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:57:42.032315 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-b5339e17-32a4-4ae8-8550-2ec0cea80e59 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments/4d887d8e-1441-4b54-b841-6b3d8ec0cb66" status: 202 len: 0 microversion: 2.1 time: 0.166990 Jul 29 11:57:42.032943 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 453/919] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Jul 29 11:57:41 2022] DELETE /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments/4d887d8e-1441-4b54-b841-6b3d8ec0cb66 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:57:43.204351 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-98045a0b-6471-4822-ad17-98dc1fdd8c4b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:43.206640 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-98045a0b-6471-4822-ad17-98dc1fdd8c4b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:43.214327 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-98045a0b-6471-4822-ad17-98dc1fdd8c4b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:43.214790 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-98045a0b-6471-4822-ad17-98dc1fdd8c4b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:43.215572 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-98045a0b-6471-4822-ad17-98dc1fdd8c4b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:43.216012 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-98045a0b-6471-4822-ad17-98dc1fdd8c4b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:43.244084 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-98045a0b-6471-4822-ad17-98dc1fdd8c4b tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043629 Jul 29 11:57:43.244633 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 467/920] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:57:43 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 11:57:43.358302 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-f970ce86-773c-4d94-9149-1ece101230f9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:43.360618 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-f970ce86-773c-4d94-9149-1ece101230f9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:43.366954 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f970ce86-773c-4d94-9149-1ece101230f9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:43.367412 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f970ce86-773c-4d94-9149-1ece101230f9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:43.368178 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f970ce86-773c-4d94-9149-1ece101230f9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:43.368618 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f970ce86-773c-4d94-9149-1ece101230f9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:43.397157 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-f970ce86-773c-4d94-9149-1ece101230f9 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043883 Jul 29 11:57:43.397739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 454/921] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Jul 29 11:57:43 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 29 11:57:43.458555 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3f25abdc-6436-4622-b08f-0e3db9a76153 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:43.459053 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3f25abdc-6436-4622-b08f-0e3db9a76153 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:43.465049 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3f25abdc-6436-4622-b08f-0e3db9a76153 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:43.465592 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3f25abdc-6436-4622-b08f-0e3db9a76153 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:43.466341 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3f25abdc-6436-4622-b08f-0e3db9a76153 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:43.466778 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3f25abdc-6436-4622-b08f-0e3db9a76153 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:43.490663 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3f25abdc-6436-4622-b08f-0e3db9a76153 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Going to try to terminate instance {{(pid=129584) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:57:43.565436 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3f25abdc-6436-4622-b08f-0e3db9a76153 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 204 len: 0 microversion: 2.1 time: 0.110368 Jul 29 11:57:43.566320 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 468/922] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:57:43 2022] DELETE /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:57:43.576146 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-58718450-80ba-43ef-859a-048ae6c83af2 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:43.576877 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-58718450-80ba-43ef-859a-048ae6c83af2 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:43.582900 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-58718450-80ba-43ef-859a-048ae6c83af2 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:43.583349 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-58718450-80ba-43ef-859a-048ae6c83af2 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:43.584104 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-58718450-80ba-43ef-859a-048ae6c83af2 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:43.584540 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-58718450-80ba-43ef-859a-048ae6c83af2 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:43.717473 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-58718450-80ba-43ef-859a-048ae6c83af2 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:57:43.725136 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-58718450-80ba-43ef-859a-048ae6c83af2 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1674 microversion: 2.1 time: 0.154422 Jul 29 11:57:43.725732 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 455/923] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:57:43 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:57:44.748277 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9f8a0563-2118-4de2-872d-40fc2b999c72 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:44.748975 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-9f8a0563-2118-4de2-872d-40fc2b999c72 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:44.755465 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9f8a0563-2118-4de2-872d-40fc2b999c72 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:44.755926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9f8a0563-2118-4de2-872d-40fc2b999c72 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:44.756689 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9f8a0563-2118-4de2-872d-40fc2b999c72 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:44.757126 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9f8a0563-2118-4de2-872d-40fc2b999c72 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:44.888491 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-9f8a0563-2118-4de2-872d-40fc2b999c72 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:57:44.896110 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-9f8a0563-2118-4de2-872d-40fc2b999c72 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1674 microversion: 2.1 time: 0.152722 Jul 29 11:57:44.896793 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 469/924] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:57:44 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:57:45.917348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ac843754-538d-47ba-915f-f0fb79b1ad18 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:45.917959 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ac843754-538d-47ba-915f-f0fb79b1ad18 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:45.924384 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ac843754-538d-47ba-915f-f0fb79b1ad18 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:45.924842 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ac843754-538d-47ba-915f-f0fb79b1ad18 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:45.925641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ac843754-538d-47ba-915f-f0fb79b1ad18 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:45.926086 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ac843754-538d-47ba-915f-f0fb79b1ad18 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:46.062107 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ac843754-538d-47ba-915f-f0fb79b1ad18 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da01b3f86d40cfa84762492eea43f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69ac15e2b1074938adfa7615f1ff1495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:57:46.069820 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ac843754-538d-47ba-915f-f0fb79b1ad18 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 200 len: 1674 microversion: 2.1 time: 0.156415 Jul 29 11:57:46.070391 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 456/925] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:57:45 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:57:46.480510 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-748efa2c-7e4b-475f-8867-6954ff8fe2c1 req-b0f82ee3-8c53-454b-a8d1-f1f4c3a5c6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b3bd77-c09f-4ae4-a164-82b13b989b64", "name": "network-vif-deleted", "tag": "15e92700-4198-47fc-8f8b-722dab6409f4"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:57:46.490531 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-748efa2c-7e4b-475f-8867-6954ff8fe2c1 req-b0f82ee3-8c53-454b-a8d1-f1f4c3a5c6b2 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:46.491223 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-748efa2c-7e4b-475f-8867-6954ff8fe2c1 req-b0f82ee3-8c53-454b-a8d1-f1f4c3a5c6b2 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:46.504864 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-748efa2c-7e4b-475f-8867-6954ff8fe2c1 req-b0f82ee3-8c53-454b-a8d1-f1f4c3a5c6b2 service nova] Creating event network-vif-deleted:15e92700-4198-47fc-8f8b-722dab6409f4 for instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 on hv-cinder-83754 Jul 29 11:57:46.510645 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-748efa2c-7e4b-475f-8867-6954ff8fe2c1 req-b0f82ee3-8c53-454b-a8d1-f1f4c3a5c6b2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099410 Jul 29 11:57:46.511741 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 470/926] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:57:47.091668 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9fe8d598-eda9-4550-b9b5-d6ddfd899be4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:47.092383 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9fe8d598-eda9-4550-b9b5-d6ddfd899be4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:47.099947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9fe8d598-eda9-4550-b9b5-d6ddfd899be4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:47.100473 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9fe8d598-eda9-4550-b9b5-d6ddfd899be4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:47.101322 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9fe8d598-eda9-4550-b9b5-d6ddfd899be4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:47.101784 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9fe8d598-eda9-4550-b9b5-d6ddfd899be4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:47.115758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-9fe8d598-eda9-4550-b9b5-d6ddfd899be4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] HTTP exception thrown: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9fe8d598-eda9-4550-b9b5-d6ddfd899be4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Request method failure captured: Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 HTTP/1.1 Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48o6abnMkKtEAVvCK3Im74o4MsLTntHsNwMRtPNUgtkRuYC8x89no_RL_RQPXKqmEUKCIQdhVB7ZSMj7fO6cFhOhVeooI5tS8ULhEOXAfuKxxIOC-CRJh4J1CoMC5ov9GddnhlVotGafUXNS4E3UEoRp1OINKvy8R83jEE5hUyK04Z8 Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 69ac15e2b1074938adfa7615f1ff1495 Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:57:47.117480 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:57:47.119284 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_69ac15e2b1074938adfa7615f1ff1495", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:57:47.119284 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:57:47.119284 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 69ac15e2b1074938adfa7615f1ff1495 Jul 29 11:57:47.119284 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:57:47.119284 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-AttachVolumeTestJSON-1787130961-project Jul 29 11:57:47.119284 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:57:47.119284 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:57:47.119284 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 20da01b3f86d40cfa84762492eea43f1 Jul 29 11:57:47.119284 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-AttachVolumeTestJSON-1787130961-project Jul 29 11:57:47.119284 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:57:47.119284 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. Jul 29 11:57:47.119284 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': 'c6b3bd77-c09f-4ae4-a164-82b13b989b64'} Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:57:47.120117 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. Jul 29 11:57:47.121565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:57:47.122757 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9fe8d598-eda9-4550-b9b5-d6ddfd899be4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Returning 404 to user: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:57:47.122757 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9fe8d598-eda9-4550-b9b5-d6ddfd899be4 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 404 len: 111 microversion: 2.1 time: 0.031195 Jul 29 11:57:47.122757 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 457/927] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:57:47 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:57:47.128396 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-36ff1944-424c-43dc-8fcf-9e31e898b96d tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '.version_select at 0x7f68f9f26310>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:47.147576 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-36ff1944-424c-43dc-8fcf-9e31e898b96d tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-234163251" status: 202 len: 0 microversion: 2.1 time: 0.023334 Jul 29 11:57:47.148142 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 471/928] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Jul 29 11:57:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-234163251 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 11:57:50.038291 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-798d8afd-0597-4a39-abae-ea32063b2555 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:50.038798 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-798d8afd-0597-4a39-abae-ea32063b2555 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:50.045882 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-798d8afd-0597-4a39-abae-ea32063b2555 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:50.046279 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-798d8afd-0597-4a39-abae-ea32063b2555 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:50.047048 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-798d8afd-0597-4a39-abae-ea32063b2555 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:50.047492 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-798d8afd-0597-4a39-abae-ea32063b2555 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:50.063243 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-798d8afd-0597-4a39-abae-ea32063b2555 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] HTTP exception thrown: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-798d8afd-0597-4a39-abae-ea32063b2555 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Request method failure captured: Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: DELETE /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 HTTP/1.1 Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48o6abnMkKtEAVvCK3Im74o4MsLTntHsNwMRtPNUgtkRuYC8x89no_RL_RQPXKqmEUKCIQdhVB7ZSMj7fO6cFhOhVeooI5tS8ULhEOXAfuKxxIOC-CRJh4J1CoMC5ov9GddnhlVotGafUXNS4E3UEoRp1OINKvy8R83jEE5hUyK04Z8 Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 69ac15e2b1074938adfa7615f1ff1495 Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:57:50.064766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:57:50.066360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_69ac15e2b1074938adfa7615f1ff1495", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:57:50.066360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:57:50.066360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 69ac15e2b1074938adfa7615f1ff1495 Jul 29 11:57:50.066360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:57:50.066360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-AttachVolumeTestJSON-1787130961-project Jul 29 11:57:50.066360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:57:50.066360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:57:50.066360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 20da01b3f86d40cfa84762492eea43f1 Jul 29 11:57:50.066360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-AttachVolumeTestJSON-1787130961-project Jul 29 11:57:50.066360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:57:50.066360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. Jul 29 11:57:50.066360 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': 'c6b3bd77-c09f-4ae4-a164-82b13b989b64'} Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:57:50.067275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. Jul 29 11:57:50.068744 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:57:50.070481 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-798d8afd-0597-4a39-abae-ea32063b2555 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Returning 404 to user: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:57:50.070481 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-798d8afd-0597-4a39-abae-ea32063b2555 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 404 len: 111 microversion: 2.1 time: 0.031809 Jul 29 11:57:50.070481 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 458/929] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:57:50 2022] DELETE /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:57:50.076527 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ff33a108-5a5e-495c-a0c5-4c9677118d66 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:50.077372 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ff33a108-5a5e-495c-a0c5-4c9677118d66 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: c6b3bd77-c09f-4ae4-a164-82b13b989b64] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:50.084197 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ff33a108-5a5e-495c-a0c5-4c9677118d66 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:50.084655 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ff33a108-5a5e-495c-a0c5-4c9677118d66 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:50.085528 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ff33a108-5a5e-495c-a0c5-4c9677118d66 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:50.086276 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ff33a108-5a5e-495c-a0c5-4c9677118d66 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:50.100363 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-ff33a108-5a5e-495c-a0c5-4c9677118d66 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] HTTP exception thrown: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ff33a108-5a5e-495c-a0c5-4c9677118d66 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Request method failure captured: Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 HTTP/1.1 Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48o6abnMkKtEAVvCK3Im74o4MsLTntHsNwMRtPNUgtkRuYC8x89no_RL_RQPXKqmEUKCIQdhVB7ZSMj7fO6cFhOhVeooI5tS8ULhEOXAfuKxxIOC-CRJh4J1CoMC5ov9GddnhlVotGafUXNS4E3UEoRp1OINKvy8R83jEE5hUyK04Z8 Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 69ac15e2b1074938adfa7615f1ff1495 Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:57:50.102007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:57:50.104136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_69ac15e2b1074938adfa7615f1ff1495", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:57:50.104136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:57:50.104136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 69ac15e2b1074938adfa7615f1ff1495 Jul 29 11:57:50.104136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:57:50.104136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-AttachVolumeTestJSON-1787130961-project Jul 29 11:57:50.104136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:57:50.104136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:57:50.104136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 20da01b3f86d40cfa84762492eea43f1 Jul 29 11:57:50.104136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-AttachVolumeTestJSON-1787130961-project Jul 29 11:57:50.104136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:57:50.104136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. Jul 29 11:57:50.104136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': 'c6b3bd77-c09f-4ae4-a164-82b13b989b64'} Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:57:50.104926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. Jul 29 11:57:50.106411 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:57:50.108046 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ff33a108-5a5e-495c-a0c5-4c9677118d66 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Returning 404 to user: Instance c6b3bd77-c09f-4ae4-a164-82b13b989b64 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:57:50.108046 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ff33a108-5a5e-495c-a0c5-4c9677118d66 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64" status: 404 len: 111 microversion: 2.1 time: 0.031548 Jul 29 11:57:50.108046 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 472/930] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:57:50 2022] GET /compute/v2.1/servers/c6b3bd77-c09f-4ae4-a164-82b13b989b64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:57:51.247964 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-57ba41d5-36c6-47d4-9bce-ea3aaeeb73d8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:51.248497 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-57ba41d5-36c6-47d4-9bce-ea3aaeeb73d8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:51.255065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-57ba41d5-36c6-47d4-9bce-ea3aaeeb73d8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:51.255521 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-57ba41d5-36c6-47d4-9bce-ea3aaeeb73d8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:51.256285 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-57ba41d5-36c6-47d4-9bce-ea3aaeeb73d8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:51.256726 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-57ba41d5-36c6-47d4-9bce-ea3aaeeb73d8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:51.271208 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-57ba41d5-36c6-47d4-9bce-ea3aaeeb73d8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] HTTP exception thrown: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-57ba41d5-36c6-47d4-9bce-ea3aaeeb73d8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Request method failure captured: Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: DELETE /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 HTTP/1.1 Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48o6abnMkKtEAVvCK3Im74o4MsLTntHsNwMRtPNUgtkRuYC8x89no_RL_RQPXKqmEUKCIQdhVB7ZSMj7fO6cFhOhVeooI5tS8ULhEOXAfuKxxIOC-CRJh4J1CoMC5ov9GddnhlVotGafUXNS4E3UEoRp1OINKvy8R83jEE5hUyK04Z8 Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 69ac15e2b1074938adfa7615f1ff1495 Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:57:51.272738 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:57:51.274131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_69ac15e2b1074938adfa7615f1ff1495", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:57:51.274131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:57:51.274131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 69ac15e2b1074938adfa7615f1ff1495 Jul 29 11:57:51.274131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:57:51.274131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-AttachVolumeTestJSON-1787130961-project Jul 29 11:57:51.274131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:57:51.274131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:57:51.274131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 20da01b3f86d40cfa84762492eea43f1 Jul 29 11:57:51.274131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-AttachVolumeTestJSON-1787130961-project Jul 29 11:57:51.274131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:57:51.274131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. Jul 29 11:57:51.274131 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': '55552e03-f570-4ef7-b624-83ed029e89a9'} Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:57:51.274893 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. Jul 29 11:57:51.276919 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:57:51.278601 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-57ba41d5-36c6-47d4-9bce-ea3aaeeb73d8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Returning 404 to user: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:57:51.278601 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-57ba41d5-36c6-47d4-9bce-ea3aaeeb73d8 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 404 len: 111 microversion: 2.1 time: 0.030522 Jul 29 11:57:51.278601 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 459/931] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:57:51 2022] DELETE /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:57:51.283239 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-7d48a43c-c2f1-4175-b2bf-81390784f645 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:57:51.283888 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-7d48a43c-c2f1-4175-b2bf-81390784f645 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] [instance: 55552e03-f570-4ef7-b624-83ed029e89a9] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:57:51.290591 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7d48a43c-c2f1-4175-b2bf-81390784f645 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:51.291788 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7d48a43c-c2f1-4175-b2bf-81390784f645 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:51.292567 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7d48a43c-c2f1-4175-b2bf-81390784f645 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:57:51.293008 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-7d48a43c-c2f1-4175-b2bf-81390784f645 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:57:51.306686 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-7d48a43c-c2f1-4175-b2bf-81390784f645 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] HTTP exception thrown: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-7d48a43c-c2f1-4175-b2bf-81390784f645 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Request method failure captured: Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 HTTP/1.1 Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48o6abnMkKtEAVvCK3Im74o4MsLTntHsNwMRtPNUgtkRuYC8x89no_RL_RQPXKqmEUKCIQdhVB7ZSMj7fO6cFhOhVeooI5tS8ULhEOXAfuKxxIOC-CRJh4J1CoMC5ov9GddnhlVotGafUXNS4E3UEoRp1OINKvy8R83jEE5hUyK04Z8 Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 69ac15e2b1074938adfa7615f1ff1495 Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:57:51.308215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:57:51.310103 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_69ac15e2b1074938adfa7615f1ff1495", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/69ac15e2b1074938adfa7615f1ff1495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:57:51.310103 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:57:51.310103 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 69ac15e2b1074938adfa7615f1ff1495 Jul 29 11:57:51.310103 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787130961 Jul 29 11:57:51.310103 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-AttachVolumeTestJSON-1787130961-project Jul 29 11:57:51.310103 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:57:51.310103 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:57:51.310103 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 20da01b3f86d40cfa84762492eea43f1 Jul 29 11:57:51.310103 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-AttachVolumeTestJSON-1787130961-project Jul 29 11:57:51.310103 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:57:51.310103 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. Jul 29 11:57:51.310103 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '55552e03-f570-4ef7-b624-83ed029e89a9'} Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:57:51.311136 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. Jul 29 11:57:51.313644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:57:51.314955 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-7d48a43c-c2f1-4175-b2bf-81390784f645 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] Returning 404 to user: Instance 55552e03-f570-4ef7-b624-83ed029e89a9 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:57:51.314955 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-7d48a43c-c2f1-4175-b2bf-81390784f645 tempest-AttachVolumeTestJSON-1787130961 tempest-AttachVolumeTestJSON-1787130961-project] 10.222.0.60 "GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9" status: 404 len: 111 microversion: 2.1 time: 0.030444 Jul 29 11:57:51.314955 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 473/932] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:57:51 2022] GET /compute/v2.1/servers/55552e03-f570-4ef7-b624-83ed029e89a9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:58:07.991290 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ad54148c-5d4f-4f33-8850-143e5833ac35 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:07.991825 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ad54148c-5d4f-4f33-8850-143e5833ac35 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:07.993170 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-e0de665b-3eb9-4f81-bfd4-dd06ccfb4c69 req-61e71fda-bc71-484b-bb83-fef74ec2250c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ff3352-15b3-4066-b66b-fe3e5c4ff2d6", "tag": "7db84d29-10d0-41a8-abf4-9bb896740271"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:58:07.995661 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=22 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:07.996542 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:07.999046 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:07.999694 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:08.002503 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ad54148c-5d4f-4f33-8850-143e5833ac35 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:08.003207 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ad54148c-5d4f-4f33-8850-143e5833ac35 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:08.004363 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ad54148c-5d4f-4f33-8850-143e5833ac35 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:08.005078 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ad54148c-5d4f-4f33-8850-143e5833ac35 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:08.007684 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-e0de665b-3eb9-4f81-bfd4-dd06ccfb4c69 req-61e71fda-bc71-484b-bb83-fef74ec2250c service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:08.008167 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-e0de665b-3eb9-4f81-bfd4-dd06ccfb4c69 req-61e71fda-bc71-484b-bb83-fef74ec2250c service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:08.023094 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-e0de665b-3eb9-4f81-bfd4-dd06ccfb4c69 req-61e71fda-bc71-484b-bb83-fef74ec2250c service nova] Creating event network-changed:7db84d29-10d0-41a8-abf4-9bb896740271 for instance 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 on hv-cinder-83754 Jul 29 11:58:08.029513 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-e0de665b-3eb9-4f81-bfd4-dd06ccfb4c69 req-61e71fda-bc71-484b-bb83-fef74ec2250c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040104 Jul 29 11:58:08.030412 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 474/933] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 11:58:08.039999 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ad54148c-5d4f-4f33-8850-143e5833ac35 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Going to try to terminate instance {{(pid=129585) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:58:08.116363 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ad54148c-5d4f-4f33-8850-143e5833ac35 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "DELETE /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 204 len: 0 microversion: 2.1 time: 0.129083 Jul 29 11:58:08.116970 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 460/934] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:58:07 2022] DELETE /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:58:08.125845 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1ae33bf8-08d1-4fb6-8586-f5acf210521c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:08.126552 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-1ae33bf8-08d1-4fb6-8586-f5acf210521c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:08.132762 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1ae33bf8-08d1-4fb6-8586-f5acf210521c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:08.133216 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1ae33bf8-08d1-4fb6-8586-f5acf210521c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:08.134041 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1ae33bf8-08d1-4fb6-8586-f5acf210521c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:08.135053 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1ae33bf8-08d1-4fb6-8586-f5acf210521c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:08.271195 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1ae33bf8-08d1-4fb6-8586-f5acf210521c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:08.279537 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1ae33bf8-08d1-4fb6-8586-f5acf210521c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.157941 Jul 29 11:58:08.280107 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 475/935] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:08 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:09.301498 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6e2fc399-68a2-47fd-b0bc-724d4b8f9182 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:09.302206 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6e2fc399-68a2-47fd-b0bc-724d4b8f9182 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:09.308745 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6e2fc399-68a2-47fd-b0bc-724d4b8f9182 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:09.309178 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6e2fc399-68a2-47fd-b0bc-724d4b8f9182 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:09.309969 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6e2fc399-68a2-47fd-b0bc-724d4b8f9182 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:09.310406 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6e2fc399-68a2-47fd-b0bc-724d4b8f9182 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:09.444421 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6e2fc399-68a2-47fd-b0bc-724d4b8f9182 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:09.452394 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6e2fc399-68a2-47fd-b0bc-724d4b8f9182 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.155153 Jul 29 11:58:09.452955 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 461/936] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:09 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:10.473318 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-aefb56d1-0872-48a2-81f7-860c12415dad tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:10.473917 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-aefb56d1-0872-48a2-81f7-860c12415dad tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:10.482067 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aefb56d1-0872-48a2-81f7-860c12415dad tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:10.482567 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aefb56d1-0872-48a2-81f7-860c12415dad tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:10.483347 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aefb56d1-0872-48a2-81f7-860c12415dad tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:10.483792 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-aefb56d1-0872-48a2-81f7-860c12415dad tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:10.614156 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-aefb56d1-0872-48a2-81f7-860c12415dad tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:10.621744 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-aefb56d1-0872-48a2-81f7-860c12415dad tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.152435 Jul 29 11:58:10.622310 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 476/937] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:10 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:11.643782 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4975849b-421a-479e-be2d-314592fc3f9c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:11.644500 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4975849b-421a-479e-be2d-314592fc3f9c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:11.651045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4975849b-421a-479e-be2d-314592fc3f9c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:11.651625 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4975849b-421a-479e-be2d-314592fc3f9c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:11.653109 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4975849b-421a-479e-be2d-314592fc3f9c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:11.653631 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4975849b-421a-479e-be2d-314592fc3f9c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:11.806378 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-4975849b-421a-479e-be2d-314592fc3f9c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:11.814493 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4975849b-421a-479e-be2d-314592fc3f9c tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1567 microversion: 2.1 time: 0.175065 Jul 29 11:58:11.815071 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 462/938] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:11 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:12.691651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-2ed10604-a38c-4806-b836-841a493a3cd8 req-40ce112f-a245-428b-989e-589325486cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ff3352-15b3-4066-b66b-fe3e5c4ff2d6", "name": "network-vif-deleted", "tag": "7db84d29-10d0-41a8-abf4-9bb896740271"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:58:12.702983 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-2ed10604-a38c-4806-b836-841a493a3cd8 req-40ce112f-a245-428b-989e-589325486cec service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:12.703440 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-2ed10604-a38c-4806-b836-841a493a3cd8 req-40ce112f-a245-428b-989e-589325486cec service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:12.716635 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-2ed10604-a38c-4806-b836-841a493a3cd8 req-40ce112f-a245-428b-989e-589325486cec service nova] Creating event network-vif-deleted:7db84d29-10d0-41a8-abf4-9bb896740271 for instance 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 on hv-cinder-83754 Jul 29 11:58:12.721441 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-2ed10604-a38c-4806-b836-841a493a3cd8 req-40ce112f-a245-428b-989e-589325486cec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033493 Jul 29 11:58:12.722038 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 477/939] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:58:12.835959 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-1d6adbb8-e124-4bd6-99de-4d9d4eadb4c3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:12.836577 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-1d6adbb8-e124-4bd6-99de-4d9d4eadb4c3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:12.843805 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1d6adbb8-e124-4bd6-99de-4d9d4eadb4c3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:12.844260 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1d6adbb8-e124-4bd6-99de-4d9d4eadb4c3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:12.845040 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1d6adbb8-e124-4bd6-99de-4d9d4eadb4c3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:12.845495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1d6adbb8-e124-4bd6-99de-4d9d4eadb4c3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:12.910158 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-1d6adbb8-e124-4bd6-99de-4d9d4eadb4c3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:12.918708 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-1d6adbb8-e124-4bd6-99de-4d9d4eadb4c3 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1219 microversion: 2.1 time: 0.086534 Jul 29 11:58:12.928803 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 463/940] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:12 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:13.940672 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-93d16208-6df5-4cbe-80e5-59f64fbb0496 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:13.941366 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-93d16208-6df5-4cbe-80e5-59f64fbb0496 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:13.947534 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-93d16208-6df5-4cbe-80e5-59f64fbb0496 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:13.948004 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-93d16208-6df5-4cbe-80e5-59f64fbb0496 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:13.949570 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-93d16208-6df5-4cbe-80e5-59f64fbb0496 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:13.950013 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-93d16208-6df5-4cbe-80e5-59f64fbb0496 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:13.981135 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-93d16208-6df5-4cbe-80e5-59f64fbb0496 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:13.981633 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-93d16208-6df5-4cbe-80e5-59f64fbb0496 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:13.982081 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-93d16208-6df5-4cbe-80e5-59f64fbb0496 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lazy-loading 'fault' on Instance uuid 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:58:14.022993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-93d16208-6df5-4cbe-80e5-59f64fbb0496 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:14.030976 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-93d16208-6df5-4cbe-80e5-59f64fbb0496 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1224 microversion: 2.1 time: 0.094933 Jul 29 11:58:14.031530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 478/941] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:13 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:15.050939 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-13c53913-e27f-468a-89a5-d93c42dac8b2 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:15.051547 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-13c53913-e27f-468a-89a5-d93c42dac8b2 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:15.058009 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-13c53913-e27f-468a-89a5-d93c42dac8b2 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:15.058648 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-13c53913-e27f-468a-89a5-d93c42dac8b2 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:15.059420 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-13c53913-e27f-468a-89a5-d93c42dac8b2 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:15.059855 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-13c53913-e27f-468a-89a5-d93c42dac8b2 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:15.090020 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-13c53913-e27f-468a-89a5-d93c42dac8b2 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:15.090462 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-13c53913-e27f-468a-89a5-d93c42dac8b2 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:15.090908 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.objects.instance [None req-13c53913-e27f-468a-89a5-d93c42dac8b2 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lazy-loading 'fault' on Instance uuid 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 {{(pid=129585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:58:15.130699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-13c53913-e27f-468a-89a5-d93c42dac8b2 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a98ee7a5076425aa7cf6cb2107da67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd8c34715e54a778911a8410e095800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:15.138412 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-13c53913-e27f-468a-89a5-d93c42dac8b2 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 200 len: 1224 microversion: 2.1 time: 0.091299 Jul 29 11:58:15.138979 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 464/942] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:15 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:16.159051 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c6b6b37a-40d0-45fa-9433-201235830803 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:16.159707 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c6b6b37a-40d0-45fa-9433-201235830803 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [instance: 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:16.166583 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c6b6b37a-40d0-45fa-9433-201235830803 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:16.167043 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c6b6b37a-40d0-45fa-9433-201235830803 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:16.168404 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c6b6b37a-40d0-45fa-9433-201235830803 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:16.168846 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c6b6b37a-40d0-45fa-9433-201235830803 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:16.185555 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-c6b6b37a-40d0-45fa-9433-201235830803 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] HTTP exception thrown: Instance 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 could not be found. Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c6b6b37a-40d0-45fa-9433-201235830803 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Request method failure captured: Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 HTTP/1.1 Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48o853cb1KQx_vJhedxW8rZFZAzYO4er-h12k8ukVhrBJkoPlZujiPj7XJqirLKExeu3ihACc6Sl02A4q8uFIWUab2iB3fMbvZJjZ-rZ0Fq0LqR3_WbtxEQ9eSZH8qU07iN17DXve82m9drbDg67UlIUwYkhQGNbH40LJGE2bXXQ7ek Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 8fd8c34715e54a778911a8410e095800 Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-TestShelveInstance-1550418190 Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:58:16.187219 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:58:16.188646 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8fd8c34715e54a778911a8410e095800"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8fd8c34715e54a778911a8410e095800", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8fd8c34715e54a778911a8410e095800"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8fd8c34715e54a778911a8410e095800"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:58:16.188646 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-TestShelveInstance-1550418190 Jul 29 11:58:16.188646 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 8fd8c34715e54a778911a8410e095800 Jul 29 11:58:16.188646 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-TestShelveInstance-1550418190 Jul 29 11:58:16.188646 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-TestShelveInstance-1550418190-project Jul 29 11:58:16.188646 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:58:16.188646 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:58:16.188646 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 2a98ee7a5076425aa7cf6cb2107da67f Jul 29 11:58:16.188646 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-TestShelveInstance-1550418190-project Jul 29 11:58:16.188646 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:58:16.188646 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 could not be found. Jul 29 11:58:16.188646 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '90ff3352-15b3-4066-b66b-fe3e5c4ff2d6'} Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 could not be found. Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:58:16.189541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 could not be found. Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 could not be found. Jul 29 11:58:16.190868 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:58:16.192052 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c6b6b37a-40d0-45fa-9433-201235830803 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Returning 404 to user: Instance 90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:58:16.192052 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c6b6b37a-40d0-45fa-9433-201235830803 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6" status: 404 len: 111 microversion: 2.1 time: 0.033509 Jul 29 11:58:16.192052 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 479/943] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:16 2022] GET /compute/v2.1/servers/90ff3352-15b3-4066-b66b-fe3e5c4ff2d6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:58:16.354018 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a7053d07-9f86-4969-a9c3-7f360c668591 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] Calling method '.version_select at 0x7f68fa0f9310>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:16.360348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a7053d07-9f86-4969-a9c3-7f360c668591 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [4001aae8-22e7-406c-94fc-5c1ca19b0fe5] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 11:58:17.368189 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO oslo.messaging._drivers.impl_rabbit [None req-a7053d07-9f86-4969-a9c3-7f360c668591 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] [4001aae8-22e7-406c-94fc-5c1ca19b0fe5] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 47122. Jul 29 11:58:17.391418 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a7053d07-9f86-4969-a9c3-7f360c668591 tempest-TestShelveInstance-1550418190 tempest-TestShelveInstance-1550418190-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1457815757" status: 202 len: 0 microversion: 2.1 time: 1.041234 Jul 29 11:58:17.392001 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 465/944] 10.222.0.60 () {58 vars in 1254 bytes} [Fri Jul 29 11:58:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1457815757 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 11:58:35.460651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=14 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:35.462218 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=26 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:35.736863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1054ea91-218b-4c95-94fd-ad244aa51a0a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Action: 'create', calling method: .version_select at 0x7f68fa104310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1597632429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyQZjjoRHaBI6F6ltDoPTVqt9Z4darPbJG4KlhvaCE0hrlQIlrraMCJOs9gPbWZamg5a1wnh/iHDj+ucJA3NmGcekdfHXc/xHZK3oQYsA+ddF9ZlhnK2MB38vo6j+05XQ=="}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:58:35.758524 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-1054ea91-218b-4c95-94fd-ad244aa51a0a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Getting quotas for project 50680cfc97cf41c18d074cb84493cde7. Resources: {'key_pairs'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:58:35.763367 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-1054ea91-218b-4c95-94fd-ad244aa51a0a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Getting quotas for user 5f9d278bd76c4ce0b90b8307b3c7d1f2 and project 50680cfc97cf41c18d074cb84493cde7. Resources: {'key_pairs'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:58:35.794015 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1054ea91-218b-4c95-94fd-ad244aa51a0a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.338623 Jul 29 11:58:35.794608 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 480/945] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Jul 29 11:58:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:58:38.563340 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5f1a8d07-4615-4943-9a04-6245dadd6104 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1972217703", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452", "networks": [{"uuid": "1d477f41-78ea-409a-9cb3-ee39089e2e6d"}]}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:58:38.572237 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:38.572901 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:38.630892 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.network.neutron [None req-5f1a8d07-4615-4943-9a04-6245dadd6104 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] validate_networks() for [('1d477f41-78ea-409a-9cb3-ee39089e2e6d', None, None, None, None, None)] {{(pid=129585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:58:39.107176 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-5f1a8d07-4615-4943-9a04-6245dadd6104 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Flavor limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:58:39.107608 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-5f1a8d07-4615-4943-9a04-6245dadd6104 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Image limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:58:39.108085 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-5f1a8d07-4615-4943-9a04-6245dadd6104 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Flavor pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:58:39.108495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-5f1a8d07-4615-4943-9a04-6245dadd6104 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Image pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:58:39.108911 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-5f1a8d07-4615-4943-9a04-6245dadd6104 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:58:39.119379 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5f1a8d07-4615-4943-9a04-6245dadd6104 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:39.120401 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5f1a8d07-4615-4943-9a04-6245dadd6104 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:39.121594 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5f1a8d07-4615-4943-9a04-6245dadd6104 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:39.122050 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5f1a8d07-4615-4943-9a04-6245dadd6104 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:39.142275 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-5f1a8d07-4615-4943-9a04-6245dadd6104 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Getting quotas for project 91aa577ac9bf45a49209c232a2237b81. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:58:39.146274 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-5f1a8d07-4615-4943-9a04-6245dadd6104 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Getting quotas for user 7531d3cff80c4c889c7ca3bcaab3afcf and project 91aa577ac9bf45a49209c232a2237b81. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:58:39.157980 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-5f1a8d07-4615-4943-9a04-6245dadd6104 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Going to run 1 instances... {{(pid=129585) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:58:39.160236 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-5f1a8d07-4615-4943-9a04-6245dadd6104 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:58:39.204719 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-5f1a8d07-4615-4943-9a04-6245dadd6104 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645295 Jul 29 11:58:39.205375 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 466/946] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:58:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 11:58:39.217306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ef268553-326e-4654-baf8-1759cf55f983 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:39.218025 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ef268553-326e-4654-baf8-1759cf55f983 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:39.277190 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ef268553-326e-4654-baf8-1759cf55f983 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:39.283825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ef268553-326e-4654-baf8-1759cf55f983 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe" status: 200 len: 1214 microversion: 2.1 time: 0.071489 Jul 29 11:58:39.284595 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 481/947] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:39 2022] GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:40.305450 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-b8b0bad1-ceec-4c96-a3fd-cae9ff7d4507 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:40.306692 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-b8b0bad1-ceec-4c96-a3fd-cae9ff7d4507 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:40.313578 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b8b0bad1-ceec-4c96-a3fd-cae9ff7d4507 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:40.314038 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b8b0bad1-ceec-4c96-a3fd-cae9ff7d4507 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:40.314817 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b8b0bad1-ceec-4c96-a3fd-cae9ff7d4507 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:40.315259 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b8b0bad1-ceec-4c96-a3fd-cae9ff7d4507 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:40.401294 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-b8b0bad1-ceec-4c96-a3fd-cae9ff7d4507 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:40.409843 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-b8b0bad1-ceec-4c96-a3fd-cae9ff7d4507 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe" status: 200 len: 1274 microversion: 2.1 time: 0.108171 Jul 29 11:58:40.410525 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 467/948] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:40 2022] GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe => generated 1274 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:41.432146 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-0635bc85-588b-4c9b-b3d3-38967aaebfad tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:41.432890 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-0635bc85-588b-4c9b-b3d3-38967aaebfad tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:41.439139 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0635bc85-588b-4c9b-b3d3-38967aaebfad tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:41.439641 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0635bc85-588b-4c9b-b3d3-38967aaebfad tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:41.440416 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0635bc85-588b-4c9b-b3d3-38967aaebfad tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:41.440850 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0635bc85-588b-4c9b-b3d3-38967aaebfad tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:41.585716 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-0635bc85-588b-4c9b-b3d3-38967aaebfad tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:41.592771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-0635bc85-588b-4c9b-b3d3-38967aaebfad tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe" status: 200 len: 1314 microversion: 2.1 time: 0.164308 Jul 29 11:58:41.593550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 482/949] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:41 2022] GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:58:41.678407 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-707e3a86-4edd-4a0b-b70b-66d6e0bc7b4d req-d4d40afd-aea4-4a11-bbbb-3201278fa51b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9371a96-d278-44a6-b7b4-b22e47e93bfe", "tag": "5534a077-5664-48e4-9dab-7197dbcf508b"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:58:41.692245 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-707e3a86-4edd-4a0b-b70b-66d6e0bc7b4d req-d4d40afd-aea4-4a11-bbbb-3201278fa51b service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:41.692833 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-707e3a86-4edd-4a0b-b70b-66d6e0bc7b4d req-d4d40afd-aea4-4a11-bbbb-3201278fa51b service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:41.710997 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-707e3a86-4edd-4a0b-b70b-66d6e0bc7b4d req-d4d40afd-aea4-4a11-bbbb-3201278fa51b service nova] Creating event network-changed:5534a077-5664-48e4-9dab-7197dbcf508b for instance c9371a96-d278-44a6-b7b4-b22e47e93bfe on hv-cinder-83754 Jul 29 11:58:41.717766 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-707e3a86-4edd-4a0b-b70b-66d6e0bc7b4d req-d4d40afd-aea4-4a11-bbbb-3201278fa51b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043404 Jul 29 11:58:41.718375 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 468/950] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:58:42.613553 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-4ba6aed9-d2d1-4284-90ef-d20e46f4805b tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:42.614172 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-4ba6aed9-d2d1-4284-90ef-d20e46f4805b tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:42.620849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4ba6aed9-d2d1-4284-90ef-d20e46f4805b tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:42.621305 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4ba6aed9-d2d1-4284-90ef-d20e46f4805b tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:42.622114 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4ba6aed9-d2d1-4284-90ef-d20e46f4805b tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:42.622763 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-4ba6aed9-d2d1-4284-90ef-d20e46f4805b tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:42.757497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-4ba6aed9-d2d1-4284-90ef-d20e46f4805b tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:42.766540 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-4ba6aed9-d2d1-4284-90ef-d20e46f4805b tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe" status: 200 len: 1314 microversion: 2.1 time: 0.156780 Jul 29 11:58:42.767112 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 483/951] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:42 2022] GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:43.788109 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-87dcdfc8-07c8-405d-98a1-831f610f744f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:43.788823 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-87dcdfc8-07c8-405d-98a1-831f610f744f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:43.795853 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-87dcdfc8-07c8-405d-98a1-831f610f744f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:43.796308 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-87dcdfc8-07c8-405d-98a1-831f610f744f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:43.797077 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-87dcdfc8-07c8-405d-98a1-831f610f744f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:43.797548 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-87dcdfc8-07c8-405d-98a1-831f610f744f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:43.930894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-87dcdfc8-07c8-405d-98a1-831f610f744f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:43.938576 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-87dcdfc8-07c8-405d-98a1-831f610f744f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe" status: 200 len: 1314 microversion: 2.1 time: 0.155098 Jul 29 11:58:43.939134 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 469/952] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:43 2022] GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:44.959342 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-cabf59a8-e58e-4dd3-bc70-7df865d03534 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:44.960055 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-cabf59a8-e58e-4dd3-bc70-7df865d03534 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:44.967340 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cabf59a8-e58e-4dd3-bc70-7df865d03534 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:44.967979 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cabf59a8-e58e-4dd3-bc70-7df865d03534 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:44.968894 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cabf59a8-e58e-4dd3-bc70-7df865d03534 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:44.969431 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-cabf59a8-e58e-4dd3-bc70-7df865d03534 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:45.106721 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-cabf59a8-e58e-4dd3-bc70-7df865d03534 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:45.114096 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-cabf59a8-e58e-4dd3-bc70-7df865d03534 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe" status: 200 len: 1314 microversion: 2.1 time: 0.158782 Jul 29 11:58:45.114663 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 484/953] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:44 2022] GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:46.134565 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-27883507-89e8-4ef9-8e63-80818503f29f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:46.135894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-27883507-89e8-4ef9-8e63-80818503f29f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:46.145018 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-27883507-89e8-4ef9-8e63-80818503f29f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:46.145500 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-27883507-89e8-4ef9-8e63-80818503f29f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:46.146293 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-27883507-89e8-4ef9-8e63-80818503f29f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:46.146759 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-27883507-89e8-4ef9-8e63-80818503f29f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:46.278539 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-27883507-89e8-4ef9-8e63-80818503f29f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:46.286116 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-27883507-89e8-4ef9-8e63-80818503f29f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe" status: 200 len: 1314 microversion: 2.1 time: 0.155493 Jul 29 11:58:46.286682 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 470/954] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:46 2022] GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:58:47.307639 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d6a4ab73-f8c3-4314-b233-de55347b7aa1 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:47.308394 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d6a4ab73-f8c3-4314-b233-de55347b7aa1 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:47.315023 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d6a4ab73-f8c3-4314-b233-de55347b7aa1 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:47.315408 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d6a4ab73-f8c3-4314-b233-de55347b7aa1 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:47.316163 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d6a4ab73-f8c3-4314-b233-de55347b7aa1 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:47.316595 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d6a4ab73-f8c3-4314-b233-de55347b7aa1 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:47.450042 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-d6a4ab73-f8c3-4314-b233-de55347b7aa1 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:47.457329 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d6a4ab73-f8c3-4314-b233-de55347b7aa1 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe" status: 200 len: 1314 microversion: 2.1 time: 0.153589 Jul 29 11:58:47.457913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 485/955] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:47 2022] GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:47.853740 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-e6608c68-9bc5-441b-be44-06e0ff70b2d0 req-903c4e4a-85e7-4df6-a8cb-5443dae2042a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9371a96-d278-44a6-b7b4-b22e47e93bfe", "name": "network-vif-plugged", "status": "completed", "tag": "5534a077-5664-48e4-9dab-7197dbcf508b"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:58:47.863302 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-e6608c68-9bc5-441b-be44-06e0ff70b2d0 req-903c4e4a-85e7-4df6-a8cb-5443dae2042a service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:47.863734 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-e6608c68-9bc5-441b-be44-06e0ff70b2d0 req-903c4e4a-85e7-4df6-a8cb-5443dae2042a service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:47.875229 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-e6608c68-9bc5-441b-be44-06e0ff70b2d0 req-903c4e4a-85e7-4df6-a8cb-5443dae2042a service nova] Creating event network-vif-plugged:5534a077-5664-48e4-9dab-7197dbcf508b for instance c9371a96-d278-44a6-b7b4-b22e47e93bfe on hv-cinder-83754 Jul 29 11:58:47.880269 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-e6608c68-9bc5-441b-be44-06e0ff70b2d0 req-903c4e4a-85e7-4df6-a8cb-5443dae2042a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153131 Jul 29 11:58:47.880899 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 471/956] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:58:48.478515 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-bc07cb71-dc37-478c-aeac-9ad2f44fbe97 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:48.479135 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-bc07cb71-dc37-478c-aeac-9ad2f44fbe97 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:48.486255 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bc07cb71-dc37-478c-aeac-9ad2f44fbe97 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:48.486711 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bc07cb71-dc37-478c-aeac-9ad2f44fbe97 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:48.487476 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bc07cb71-dc37-478c-aeac-9ad2f44fbe97 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:48.487909 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bc07cb71-dc37-478c-aeac-9ad2f44fbe97 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:48.615232 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bc07cb71-dc37-478c-aeac-9ad2f44fbe97 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:48.623132 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-bc07cb71-dc37-478c-aeac-9ad2f44fbe97 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe" status: 200 len: 1314 microversion: 2.1 time: 0.148432 Jul 29 11:58:48.623699 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 486/957] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:48 2022] GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:49.650944 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9c20d934-e3f9-4e4b-be01-68272f38c53c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:49.651913 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9c20d934-e3f9-4e4b-be01-68272f38c53c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:49.654332 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:49.655006 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=6 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:49.661202 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9c20d934-e3f9-4e4b-be01-68272f38c53c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:49.661689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9c20d934-e3f9-4e4b-be01-68272f38c53c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:49.662461 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9c20d934-e3f9-4e4b-be01-68272f38c53c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:49.662903 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9c20d934-e3f9-4e4b-be01-68272f38c53c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:49.795572 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9c20d934-e3f9-4e4b-be01-68272f38c53c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:49.803049 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9c20d934-e3f9-4e4b-be01-68272f38c53c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe" status: 200 len: 1496 microversion: 2.1 time: 0.156522 Jul 29 11:58:49.803619 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 472/958] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:49 2022] GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:50.213634 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6a887b4d-0d22-46c2-a75c-47fb33d570e8 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:50.214303 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6a887b4d-0d22-46c2-a75c-47fb33d570e8 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:50.215941 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=6 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:58:50.221709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6a887b4d-0d22-46c2-a75c-47fb33d570e8 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:50.222165 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6a887b4d-0d22-46c2-a75c-47fb33d570e8 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:50.222932 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6a887b4d-0d22-46c2-a75c-47fb33d570e8 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:50.223371 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6a887b4d-0d22-46c2-a75c-47fb33d570e8 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:50.251771 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6a887b4d-0d22-46c2-a75c-47fb33d570e8 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] Going to try to terminate instance {{(pid=129584) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:58:50.329913 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-6a887b4d-0d22-46c2-a75c-47fb33d570e8 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe" status: 204 len: 0 microversion: 2.1 time: 0.119786 Jul 29 11:58:50.330663 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 487/959] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:58:50 2022] DELETE /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:58:50.338799 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-cb993396-745f-429b-8d11-5e98f394340c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:50.339419 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-cb993396-745f-429b-8d11-5e98f394340c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:50.345544 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cb993396-745f-429b-8d11-5e98f394340c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:50.345998 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cb993396-745f-429b-8d11-5e98f394340c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:50.346762 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cb993396-745f-429b-8d11-5e98f394340c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:50.347204 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-cb993396-745f-429b-8d11-5e98f394340c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:50.476995 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-cb993396-745f-429b-8d11-5e98f394340c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:50.485512 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-cb993396-745f-429b-8d11-5e98f394340c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe" status: 200 len: 1502 microversion: 2.1 time: 0.150610 Jul 29 11:58:50.486093 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 473/960] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:50 2022] GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:51.507399 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-be4ebfc2-66fc-40be-8ca0-6b78e2737760 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:51.508015 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-be4ebfc2-66fc-40be-8ca0-6b78e2737760 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:51.515307 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-be4ebfc2-66fc-40be-8ca0-6b78e2737760 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:51.515761 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-be4ebfc2-66fc-40be-8ca0-6b78e2737760 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:51.516530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-be4ebfc2-66fc-40be-8ca0-6b78e2737760 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:51.516968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-be4ebfc2-66fc-40be-8ca0-6b78e2737760 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:51.645405 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-be4ebfc2-66fc-40be-8ca0-6b78e2737760 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:51.653312 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-be4ebfc2-66fc-40be-8ca0-6b78e2737760 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe" status: 200 len: 1502 microversion: 2.1 time: 0.150312 Jul 29 11:58:51.653914 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 488/961] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:51 2022] GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:52.403546 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-be135dab-6654-4a3d-8021-94d6003b2b5b req-c7c4c040-a18f-4b0d-9a3a-c8180b60549a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9371a96-d278-44a6-b7b4-b22e47e93bfe", "name": "network-vif-deleted", "tag": "5534a077-5664-48e4-9dab-7197dbcf508b"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:58:52.414798 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-be135dab-6654-4a3d-8021-94d6003b2b5b req-c7c4c040-a18f-4b0d-9a3a-c8180b60549a service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:52.415171 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-be135dab-6654-4a3d-8021-94d6003b2b5b req-c7c4c040-a18f-4b0d-9a3a-c8180b60549a service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:52.427671 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-be135dab-6654-4a3d-8021-94d6003b2b5b req-c7c4c040-a18f-4b0d-9a3a-c8180b60549a service nova] Creating event network-vif-deleted:5534a077-5664-48e4-9dab-7197dbcf508b for instance c9371a96-d278-44a6-b7b4-b22e47e93bfe on hv-cinder-83754 Jul 29 11:58:52.433449 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-be135dab-6654-4a3d-8021-94d6003b2b5b req-c7c4c040-a18f-4b0d-9a3a-c8180b60549a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033857 Jul 29 11:58:52.434039 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 474/962] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:58:52.675714 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-57f536f2-d387-4b1b-ad09-c3c01855b24f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:52.676337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-57f536f2-d387-4b1b-ad09-c3c01855b24f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:52.682937 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-57f536f2-d387-4b1b-ad09-c3c01855b24f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:52.683565 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-57f536f2-d387-4b1b-ad09-c3c01855b24f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:52.684337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-57f536f2-d387-4b1b-ad09-c3c01855b24f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:52.684780 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-57f536f2-d387-4b1b-ad09-c3c01855b24f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:52.717395 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-57f536f2-d387-4b1b-ad09-c3c01855b24f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:52.717872 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-57f536f2-d387-4b1b-ad09-c3c01855b24f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:52.718327 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-57f536f2-d387-4b1b-ad09-c3c01855b24f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lazy-loading 'fault' on Instance uuid c9371a96-d278-44a6-b7b4-b22e47e93bfe {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:58:52.761559 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-57f536f2-d387-4b1b-ad09-c3c01855b24f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:52.769158 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-57f536f2-d387-4b1b-ad09-c3c01855b24f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe" status: 200 len: 1304 microversion: 2.1 time: 0.097365 Jul 29 11:58:52.769754 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 489/963] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:52 2022] GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:53.578000 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-0f4562d0-fdee-41b9-a9d2-32197ce2d2c3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-631897643", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1597632429", "security_groups": [{"name": "tempest-secgroup-smoke-225531464"}], "block_device_mapping_v2": [{"uuid": "a6f3d38b-2fd5-4a70-a5fb-772e93f62fa4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2c64f75-d35e-4ef4-8a4c-54a037caa5bc"}]}} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:58:53.688561 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.network.neutron [None req-0f4562d0-fdee-41b9-a9d2-32197ce2d2c3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] validate_networks() for [('b2c64f75-d35e-4ef4-8a4c-54a037caa5bc', None, None, None, None, None)] {{(pid=129585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:58:53.790482 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-8a7bdcdf-a8d2-4157-8e19-8f4886783302 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:53.791097 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-8a7bdcdf-a8d2-4157-8e19-8f4886783302 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: c9371a96-d278-44a6-b7b4-b22e47e93bfe] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:53.798116 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8a7bdcdf-a8d2-4157-8e19-8f4886783302 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:53.798566 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8a7bdcdf-a8d2-4157-8e19-8f4886783302 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:53.799337 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8a7bdcdf-a8d2-4157-8e19-8f4886783302 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:53.799774 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8a7bdcdf-a8d2-4157-8e19-8f4886783302 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:53.813904 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-8a7bdcdf-a8d2-4157-8e19-8f4886783302 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] HTTP exception thrown: Instance c9371a96-d278-44a6-b7b4-b22e47e93bfe could not be found. Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-8a7bdcdf-a8d2-4157-8e19-8f4886783302 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Request method failure captured: Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe HTTP/1.1 Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48tsRLFjWiwiKMGXZoL4xzfEgBPfn397mBM-SoA8Nl7sOepDUoHZRr6-41vqG3TXjk32meGKThupLCwr2BPbu-BhPZVxLmtC9mYdSn6rrGxRohe4GQAUlwC5GQszcj3uPsLaIDyXLv1VED80AH_nS5Ab1uy06YNZgoHj4EBqqwAZ4Ig Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 91aa577ac9bf45a49209c232a2237b81 Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-VolumesActionsTest-2088256358 Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 11:58:53.815578 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 11:58:53.817246 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91aa577ac9bf45a49209c232a2237b81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_91aa577ac9bf45a49209c232a2237b81", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/91aa577ac9bf45a49209c232a2237b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91aa577ac9bf45a49209c232a2237b81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:58:53.817246 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-VolumesActionsTest-2088256358 Jul 29 11:58:53.817246 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 91aa577ac9bf45a49209c232a2237b81 Jul 29 11:58:53.817246 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-VolumesActionsTest-2088256358 Jul 29 11:58:53.817246 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-VolumesActionsTest-2088256358-project Jul 29 11:58:53.817246 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 11:58:53.817246 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 11:58:53.817246 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 7531d3cff80c4c889c7ca3bcaab3afcf Jul 29 11:58:53.817246 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-VolumesActionsTest-2088256358-project Jul 29 11:58:53.817246 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 11:58:53.817246 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance c9371a96-d278-44a6-b7b4-b22e47e93bfe could not be found. Jul 29 11:58:53.817246 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': 'c9371a96-d278-44a6-b7b4-b22e47e93bfe'} Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9371a96-d278-44a6-b7b4-b22e47e93bfe could not be found. Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:58:53.818244 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9371a96-d278-44a6-b7b4-b22e47e93bfe could not be found. Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9371a96-d278-44a6-b7b4-b22e47e93bfe could not be found. Jul 29 11:58:53.819825 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 11:58:53.821240 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-8a7bdcdf-a8d2-4157-8e19-8f4886783302 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Returning 404 to user: Instance c9371a96-d278-44a6-b7b4-b22e47e93bfe could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:58:53.821240 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-8a7bdcdf-a8d2-4157-8e19-8f4886783302 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe" status: 404 len: 111 microversion: 2.1 time: 0.030410 Jul 29 11:58:53.821240 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 490/964] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:53 2022] GET /compute/v2.1/servers/c9371a96-d278-44a6-b7b4-b22e47e93bfe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:58:53.867070 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-361d9b96-cd3e-4b63-b303-33451e8e231f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-131513380", "imageRef": "b8cf097b-3302-4a40-b820-1548adec68c5", "flavorRef": "452", "networks": [{"uuid": "1d477f41-78ea-409a-9cb3-ee39089e2e6d"}]}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:58:53.922397 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.network.neutron [None req-361d9b96-cd3e-4b63-b303-33451e8e231f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] validate_networks() for [('1d477f41-78ea-409a-9cb3-ee39089e2e6d', None, None, None, None, None)] {{(pid=129584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 11:58:54.180063 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-0f4562d0-fdee-41b9-a9d2-32197ce2d2c3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Flavor limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:58:54.180485 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-0f4562d0-fdee-41b9-a9d2-32197ce2d2c3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Image limits 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:58:54.180953 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-0f4562d0-fdee-41b9-a9d2-32197ce2d2c3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Flavor pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:58:54.181358 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-0f4562d0-fdee-41b9-a9d2-32197ce2d2c3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Image pref 0:0:0 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:58:54.181810 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.virt.hardware [None req-0f4562d0-fdee-41b9-a9d2-32197ce2d2c3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:58:54.192133 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0f4562d0-fdee-41b9-a9d2-32197ce2d2c3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:54.192829 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0f4562d0-fdee-41b9-a9d2-32197ce2d2c3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:54.193384 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0f4562d0-fdee-41b9-a9d2-32197ce2d2c3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:54.193861 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0f4562d0-fdee-41b9-a9d2-32197ce2d2c3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:54.211016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-0f4562d0-fdee-41b9-a9d2-32197ce2d2c3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Getting quotas for project 50680cfc97cf41c18d074cb84493cde7. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:58:54.215380 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.quota [None req-0f4562d0-fdee-41b9-a9d2-32197ce2d2c3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Getting quotas for user 5f9d278bd76c4ce0b90b8307b3c7d1f2 and project 50680cfc97cf41c18d074cb84493cde7. Resources: {'instances', 'ram', 'cores'} {{(pid=129585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:58:54.273236 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-0f4562d0-fdee-41b9-a9d2-32197ce2d2c3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Going to run 1 instances... {{(pid=129585) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:58:54.275566 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-0f4562d0-fdee-41b9-a9d2-32197ce2d2c3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6f3d38b-2fd5-4a70-a5fb-772e93f62fa4',volume_size=None,volume_type=None)] {{(pid=129585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:58:54.378377 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-361d9b96-cd3e-4b63-b303-33451e8e231f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Flavor limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 11:58:54.378938 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-361d9b96-cd3e-4b63-b303-33451e8e231f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Image limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 11:58:54.379550 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-361d9b96-cd3e-4b63-b303-33451e8e231f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Flavor pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 11:58:54.380087 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-361d9b96-cd3e-4b63-b303-33451e8e231f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Image pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 11:58:54.380738 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-361d9b96-cd3e-4b63-b303-33451e8e231f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 11:58:54.390796 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-361d9b96-cd3e-4b63-b303-33451e8e231f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:54.391245 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-361d9b96-cd3e-4b63-b303-33451e8e231f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:54.392046 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-361d9b96-cd3e-4b63-b303-33451e8e231f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:54.392486 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-361d9b96-cd3e-4b63-b303-33451e8e231f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:54.405674 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-0f4562d0-fdee-41b9-a9d2-32197ce2d2c3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.832674 Jul 29 11:58:54.406511 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 475/965] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:58:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 11:58:54.409999 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-361d9b96-cd3e-4b63-b303-33451e8e231f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Getting quotas for project 91aa577ac9bf45a49209c232a2237b81. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 11:58:54.414198 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-361d9b96-cd3e-4b63-b303-33451e8e231f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Getting quotas for user 7531d3cff80c4c889c7ca3bcaab3afcf and project 91aa577ac9bf45a49209c232a2237b81. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 11:58:54.418034 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-3371cb19-eba1-4293-a310-df7504a5b9eb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:54.418733 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-3371cb19-eba1-4293-a310-df7504a5b9eb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:54.427343 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-361d9b96-cd3e-4b63-b303-33451e8e231f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Going to run 1 instances... {{(pid=129584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 11:58:54.429658 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-361d9b96-cd3e-4b63-b303-33451e8e231f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cf097b-3302-4a40-b820-1548adec68c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 11:58:54.473875 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-3371cb19-eba1-4293-a310-df7504a5b9eb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:54.482201 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-3371cb19-eba1-4293-a310-df7504a5b9eb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1094 microversion: 2.1 time: 0.068861 Jul 29 11:58:54.482422 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-361d9b96-cd3e-4b63-b303-33451e8e231f tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619202 Jul 29 11:58:54.492705 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 476/966] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:54 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:58:54.492905 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 491/967] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 11:58:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 11:58:54.498382 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-0c2ef516-b847-4f67-8f4b-8d4620124139 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:54.498990 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-0c2ef516-b847-4f67-8f4b-8d4620124139 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:54.568427 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-0c2ef516-b847-4f67-8f4b-8d4620124139 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:54.577838 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-0c2ef516-b847-4f67-8f4b-8d4620124139 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775" status: 200 len: 1213 microversion: 2.1 time: 0.083172 Jul 29 11:58:54.580429 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 477/968] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:54 2022] GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:55.503285 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e4ebbede-13ed-452e-b79f-ed43a403d6a9 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:55.503897 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e4ebbede-13ed-452e-b79f-ed43a403d6a9 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:55.510716 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e4ebbede-13ed-452e-b79f-ed43a403d6a9 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:55.511118 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e4ebbede-13ed-452e-b79f-ed43a403d6a9 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:55.512137 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e4ebbede-13ed-452e-b79f-ed43a403d6a9 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:55.512575 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e4ebbede-13ed-452e-b79f-ed43a403d6a9 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:55.577568 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e4ebbede-13ed-452e-b79f-ed43a403d6a9 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:55.585029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e4ebbede-13ed-452e-b79f-ed43a403d6a9 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1200 microversion: 2.1 time: 0.086120 Jul 29 11:58:55.585622 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 492/969] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:55 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1200 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:55.598832 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-7c7b64be-046a-4c42-bfc9-653777207570 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:55.599451 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-7c7b64be-046a-4c42-bfc9-653777207570 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:55.607321 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7c7b64be-046a-4c42-bfc9-653777207570 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:55.607779 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7c7b64be-046a-4c42-bfc9-653777207570 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:55.608537 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7c7b64be-046a-4c42-bfc9-653777207570 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:55.608982 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-7c7b64be-046a-4c42-bfc9-653777207570 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:55.684484 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-7c7b64be-046a-4c42-bfc9-653777207570 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:55.693234 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-7c7b64be-046a-4c42-bfc9-653777207570 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775" status: 200 len: 1265 microversion: 2.1 time: 0.098132 Jul 29 11:58:55.693868 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 478/970] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:55 2022] GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 => generated 1265 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:58:56.606098 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b2e0142c-d9b2-481b-b479-9420ca2859f3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:56.606854 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b2e0142c-d9b2-481b-b479-9420ca2859f3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:56.613390 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b2e0142c-d9b2-481b-b479-9420ca2859f3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:56.613928 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b2e0142c-d9b2-481b-b479-9420ca2859f3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:56.614717 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b2e0142c-d9b2-481b-b479-9420ca2859f3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:56.615160 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b2e0142c-d9b2-481b-b479-9420ca2859f3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:56.679462 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-b2e0142c-d9b2-481b-b479-9420ca2859f3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:56.687176 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b2e0142c-d9b2-481b-b479-9420ca2859f3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1198 microversion: 2.1 time: 0.085938 Jul 29 11:58:56.687749 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 493/971] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:56 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:56.716503 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-5bd1532e-aefe-404f-980f-d43045c4ebb8 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:56.717128 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-5bd1532e-aefe-404f-980f-d43045c4ebb8 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:56.723711 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5bd1532e-aefe-404f-980f-d43045c4ebb8 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:56.724173 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5bd1532e-aefe-404f-980f-d43045c4ebb8 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:56.724954 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5bd1532e-aefe-404f-980f-d43045c4ebb8 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:56.725559 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-5bd1532e-aefe-404f-980f-d43045c4ebb8 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:56.788411 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-5bd1532e-aefe-404f-980f-d43045c4ebb8 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:56.796658 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-5bd1532e-aefe-404f-980f-d43045c4ebb8 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775" status: 200 len: 1271 microversion: 2.1 time: 0.084922 Jul 29 11:58:56.797448 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 479/972] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:56 2022] GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:57.708265 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-be0471b7-ceae-43f9-ab48-87c7552987ca tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:57.709117 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-be0471b7-ceae-43f9-ab48-87c7552987ca tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:57.715813 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-be0471b7-ceae-43f9-ab48-87c7552987ca tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:57.716348 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-be0471b7-ceae-43f9-ab48-87c7552987ca tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:57.717195 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-be0471b7-ceae-43f9-ab48-87c7552987ca tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:57.717745 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-be0471b7-ceae-43f9-ab48-87c7552987ca tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:57.818444 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-3811abac-bfa7-472a-9667-f355810d7963 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:57.819407 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-3811abac-bfa7-472a-9667-f355810d7963 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:57.829106 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3811abac-bfa7-472a-9667-f355810d7963 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:57.842650 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3811abac-bfa7-472a-9667-f355810d7963 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:57.844353 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3811abac-bfa7-472a-9667-f355810d7963 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:57.846807 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3811abac-bfa7-472a-9667-f355810d7963 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:58.192992 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-be0471b7-ceae-43f9-ab48-87c7552987ca tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:58.196428 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-3811abac-bfa7-472a-9667-f355810d7963 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:58.202335 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-be0471b7-ceae-43f9-ab48-87c7552987ca tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1265 microversion: 2.1 time: 0.497990 Jul 29 11:58:58.203993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 494/973] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:57 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1265 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:58.216962 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-3811abac-bfa7-472a-9667-f355810d7963 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775" status: 200 len: 1313 microversion: 2.1 time: 0.389499 Jul 29 11:58:58.217633 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 480/974] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:57 2022] GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:58:58.326977 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-4207281c-a943-42bf-b426-0bd1fba00965 req-76971ed1-f716-4d4a-9b6e-3766a6d94e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d7fca80-ac19-4168-a7a5-d81c33e85775", "tag": "859b9d5d-52e3-499e-a74a-28a9f442fba2"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:58:58.346035 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-4207281c-a943-42bf-b426-0bd1fba00965 req-76971ed1-f716-4d4a-9b6e-3766a6d94e9d service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:58.346797 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-4207281c-a943-42bf-b426-0bd1fba00965 req-76971ed1-f716-4d4a-9b6e-3766a6d94e9d service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:58.366577 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-4207281c-a943-42bf-b426-0bd1fba00965 req-76971ed1-f716-4d4a-9b6e-3766a6d94e9d service nova] Creating event network-changed:859b9d5d-52e3-499e-a74a-28a9f442fba2 for instance 1d7fca80-ac19-4168-a7a5-d81c33e85775 on hv-cinder-83754 Jul 29 11:58:58.372606 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-4207281c-a943-42bf-b426-0bd1fba00965 req-76971ed1-f716-4d4a-9b6e-3766a6d94e9d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050503 Jul 29 11:58:58.373381 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 495/975] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:58:59.227407 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-31848b2f-16c2-4acc-a736-ac66df642293 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:59.228070 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-31848b2f-16c2-4acc-a736-ac66df642293 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:59.235412 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-31848b2f-16c2-4acc-a736-ac66df642293 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:59.235851 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-31848b2f-16c2-4acc-a736-ac66df642293 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:59.236632 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-31848b2f-16c2-4acc-a736-ac66df642293 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:59.237070 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-31848b2f-16c2-4acc-a736-ac66df642293 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:59.238672 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-1e381f5f-80da-465b-9195-2033d75bd323 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:58:59.239562 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-1e381f5f-80da-465b-9195-2033d75bd323 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:58:59.247657 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1e381f5f-80da-465b-9195-2033d75bd323 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:59.248203 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1e381f5f-80da-465b-9195-2033d75bd323 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:59.248962 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1e381f5f-80da-465b-9195-2033d75bd323 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:58:59.249393 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-1e381f5f-80da-465b-9195-2033d75bd323 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:58:59.434966 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-31848b2f-16c2-4acc-a736-ac66df642293 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:59.439011 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-1e381f5f-80da-465b-9195-2033d75bd323 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:58:59.442750 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-31848b2f-16c2-4acc-a736-ac66df642293 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1265 microversion: 2.1 time: 0.219166 Jul 29 11:58:59.443325 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 481/976] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:59 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:58:59.447174 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-1e381f5f-80da-465b-9195-2033d75bd323 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775" status: 200 len: 1313 microversion: 2.1 time: 0.212668 Jul 29 11:58:59.447888 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 496/977] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:58:59 2022] GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:59:00.395523 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-6e1647c4-07ed-4737-ad3e-f6b3aa98082e req-f1b7ffb9-6694-42a4-9429-57e06b3ae6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131", "tag": "99107bc0-ee01-47c9-bc6e-90d9cc0f9dc0"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:59:00.405562 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-6e1647c4-07ed-4737-ad3e-f6b3aa98082e req-f1b7ffb9-6694-42a4-9429-57e06b3ae6d0 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:00.405944 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-6e1647c4-07ed-4737-ad3e-f6b3aa98082e req-f1b7ffb9-6694-42a4-9429-57e06b3ae6d0 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:00.418981 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-6e1647c4-07ed-4737-ad3e-f6b3aa98082e req-f1b7ffb9-6694-42a4-9429-57e06b3ae6d0 service nova] Creating event network-changed:99107bc0-ee01-47c9-bc6e-90d9cc0f9dc0 for instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 on hv-cinder-83754 Jul 29 11:59:00.423894 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-6e1647c4-07ed-4737-ad3e-f6b3aa98082e req-f1b7ffb9-6694-42a4-9429-57e06b3ae6d0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032195 Jul 29 11:59:00.424483 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 482/978] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:59:00.464359 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-8092c25c-4451-4e60-918d-77e97c193f64 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:00.464979 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-8092c25c-4451-4e60-918d-77e97c193f64 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:00.471061 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9e3d629c-01ed-4e78-aa38-6c227586b2fe tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:00.471671 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8092c25c-4451-4e60-918d-77e97c193f64 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:00.472067 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9e3d629c-01ed-4e78-aa38-6c227586b2fe tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:00.472194 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8092c25c-4451-4e60-918d-77e97c193f64 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:00.473535 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8092c25c-4451-4e60-918d-77e97c193f64 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:00.473966 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-8092c25c-4451-4e60-918d-77e97c193f64 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:00.479244 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9e3d629c-01ed-4e78-aa38-6c227586b2fe tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:00.479851 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9e3d629c-01ed-4e78-aa38-6c227586b2fe tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:00.480733 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9e3d629c-01ed-4e78-aa38-6c227586b2fe tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:00.481178 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9e3d629c-01ed-4e78-aa38-6c227586b2fe tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:00.683538 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-8092c25c-4451-4e60-918d-77e97c193f64 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:00.688302 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9e3d629c-01ed-4e78-aa38-6c227586b2fe tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:00.692682 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-8092c25c-4451-4e60-918d-77e97c193f64 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1265 microversion: 2.1 time: 0.233181 Jul 29 11:59:00.693268 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 497/979] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:00 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:59:00.696844 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9e3d629c-01ed-4e78-aa38-6c227586b2fe tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775" status: 200 len: 1313 microversion: 2.1 time: 0.232895 Jul 29 11:59:00.697600 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 483/980] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:00 2022] GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:59:01.715222 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ce447a67-70d6-4ab6-ba09-6f4d7b02fca6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:01.715982 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ce447a67-70d6-4ab6-ba09-6f4d7b02fca6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:01.718534 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-3a3a2de8-3543-4672-98aa-1b162b5ac70c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:01.719163 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-3a3a2de8-3543-4672-98aa-1b162b5ac70c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:01.722848 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ce447a67-70d6-4ab6-ba09-6f4d7b02fca6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:01.723302 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ce447a67-70d6-4ab6-ba09-6f4d7b02fca6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:01.724068 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ce447a67-70d6-4ab6-ba09-6f4d7b02fca6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:01.724690 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ce447a67-70d6-4ab6-ba09-6f4d7b02fca6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:01.725359 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3a3a2de8-3543-4672-98aa-1b162b5ac70c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:01.725976 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3a3a2de8-3543-4672-98aa-1b162b5ac70c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:01.726756 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3a3a2de8-3543-4672-98aa-1b162b5ac70c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:01.727203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-3a3a2de8-3543-4672-98aa-1b162b5ac70c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:01.743388 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:59:01.923544 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-3a3a2de8-3543-4672-98aa-1b162b5ac70c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:01.931301 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-3a3a2de8-3543-4672-98aa-1b162b5ac70c tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775" status: 200 len: 1313 microversion: 2.1 time: 0.216495 Jul 29 11:59:01.932816 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 484/981] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:01 2022] GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:59:01.933177 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ce447a67-70d6-4ab6-ba09-6f4d7b02fca6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:01.942514 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ce447a67-70d6-4ab6-ba09-6f4d7b02fca6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1265 microversion: 2.1 time: 0.231894 Jul 29 11:59:01.943228 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 498/982] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:01 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:59:02.953073 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-9187d8c0-99ad-4c28-8ff6-5d29e98d8ad9 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:02.953743 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-9187d8c0-99ad-4c28-8ff6-5d29e98d8ad9 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:02.960278 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9187d8c0-99ad-4c28-8ff6-5d29e98d8ad9 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:02.960762 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9187d8c0-99ad-4c28-8ff6-5d29e98d8ad9 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:02.961558 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9187d8c0-99ad-4c28-8ff6-5d29e98d8ad9 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:02.961997 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-9187d8c0-99ad-4c28-8ff6-5d29e98d8ad9 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:02.964959 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-2004bebf-d13e-4a8e-b553-7a00c48d01c0 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:02.965677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-2004bebf-d13e-4a8e-b553-7a00c48d01c0 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:02.972287 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2004bebf-d13e-4a8e-b553-7a00c48d01c0 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:02.972759 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2004bebf-d13e-4a8e-b553-7a00c48d01c0 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:02.973600 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2004bebf-d13e-4a8e-b553-7a00c48d01c0 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:02.974046 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2004bebf-d13e-4a8e-b553-7a00c48d01c0 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:03.162793 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-9187d8c0-99ad-4c28-8ff6-5d29e98d8ad9 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:03.166294 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2004bebf-d13e-4a8e-b553-7a00c48d01c0 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:03.170541 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-9187d8c0-99ad-4c28-8ff6-5d29e98d8ad9 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775" status: 200 len: 1313 microversion: 2.1 time: 0.221372 Jul 29 11:59:03.171114 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 485/983] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:02 2022] GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:59:03.174242 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-2004bebf-d13e-4a8e-b553-7a00c48d01c0 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1265 microversion: 2.1 time: 0.213862 Jul 29 11:59:03.174986 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 499/984] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:02 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:59:03.858098 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-154f22b0-8279-4b83-ad8d-1b0b62cdad15 req-92f11f47-3863-42bc-98ca-7ebf80804232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d7fca80-ac19-4168-a7a5-d81c33e85775", "name": "network-vif-plugged", "status": "completed", "tag": "859b9d5d-52e3-499e-a74a-28a9f442fba2"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:59:03.867358 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-154f22b0-8279-4b83-ad8d-1b0b62cdad15 req-92f11f47-3863-42bc-98ca-7ebf80804232 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:03.867801 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-154f22b0-8279-4b83-ad8d-1b0b62cdad15 req-92f11f47-3863-42bc-98ca-7ebf80804232 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:03.879252 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-154f22b0-8279-4b83-ad8d-1b0b62cdad15 req-92f11f47-3863-42bc-98ca-7ebf80804232 service nova] Creating event network-vif-plugged:859b9d5d-52e3-499e-a74a-28a9f442fba2 for instance 1d7fca80-ac19-4168-a7a5-d81c33e85775 on hv-cinder-83754 Jul 29 11:59:03.884197 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-154f22b0-8279-4b83-ad8d-1b0b62cdad15 req-92f11f47-3863-42bc-98ca-7ebf80804232 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030348 Jul 29 11:59:03.884802 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 486/985] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:59:04.190929 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-650deb74-f0dc-4cf5-884e-3462cec8b09d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:04.191560 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-650deb74-f0dc-4cf5-884e-3462cec8b09d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:04.195206 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a142377d-37fc-48f6-8440-0a0e86c6513b tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:04.195906 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a142377d-37fc-48f6-8440-0a0e86c6513b tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:04.198375 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-650deb74-f0dc-4cf5-884e-3462cec8b09d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:04.198850 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-650deb74-f0dc-4cf5-884e-3462cec8b09d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:04.200036 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-650deb74-f0dc-4cf5-884e-3462cec8b09d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:04.200479 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-650deb74-f0dc-4cf5-884e-3462cec8b09d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:04.201664 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:59:04.203699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a142377d-37fc-48f6-8440-0a0e86c6513b tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:04.204183 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a142377d-37fc-48f6-8440-0a0e86c6513b tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:04.204942 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a142377d-37fc-48f6-8440-0a0e86c6513b tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:04.205370 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a142377d-37fc-48f6-8440-0a0e86c6513b tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:04.399493 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-650deb74-f0dc-4cf5-884e-3462cec8b09d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:04.401903 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=2 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:59:04.403921 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a142377d-37fc-48f6-8440-0a0e86c6513b tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:04.409378 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-650deb74-f0dc-4cf5-884e-3462cec8b09d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775" status: 200 len: 1313 microversion: 2.1 time: 0.222368 Jul 29 11:59:04.409980 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 500/986] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:04 2022] GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:59:04.411692 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a142377d-37fc-48f6-8440-0a0e86c6513b tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1265 microversion: 2.1 time: 0.220579 Jul 29 11:59:04.412269 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 487/987] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:04 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:59:05.429926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-05fec244-67c3-4ae6-9dd2-c858c24c2c6a tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:05.430543 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-05fec244-67c3-4ae6-9dd2-c858c24c2c6a tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:05.432199 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-81077612-95cf-4fa3-bf74-7579cf125bfd tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:05.432652 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=6 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:59:05.432824 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-81077612-95cf-4fa3-bf74-7579cf125bfd tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:05.435712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=10 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:59:05.439062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-05fec244-67c3-4ae6-9dd2-c858c24c2c6a tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:05.439509 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-05fec244-67c3-4ae6-9dd2-c858c24c2c6a tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:05.440274 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-05fec244-67c3-4ae6-9dd2-c858c24c2c6a tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:05.440708 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-05fec244-67c3-4ae6-9dd2-c858c24c2c6a tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:05.441706 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-81077612-95cf-4fa3-bf74-7579cf125bfd tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:05.442173 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-81077612-95cf-4fa3-bf74-7579cf125bfd tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:05.442959 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-81077612-95cf-4fa3-bf74-7579cf125bfd tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:05.443400 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-81077612-95cf-4fa3-bf74-7579cf125bfd tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:05.641110 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-05fec244-67c3-4ae6-9dd2-c858c24c2c6a tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:05.645948 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-81077612-95cf-4fa3-bf74-7579cf125bfd tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:05.649072 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-05fec244-67c3-4ae6-9dd2-c858c24c2c6a tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775" status: 200 len: 1313 microversion: 2.1 time: 0.222814 Jul 29 11:59:05.649774 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 501/988] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:05 2022] GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:59:05.654454 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-81077612-95cf-4fa3-bf74-7579cf125bfd tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1265 microversion: 2.1 time: 0.226044 Jul 29 11:59:05.655028 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 488/989] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:05 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:59:06.671290 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-60922160-8353-4a1f-9825-f98dbaa57616 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:06.671834 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-60922160-8353-4a1f-9825-f98dbaa57616 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:06.674121 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:59:06.674765 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-938e2d76-797e-4aff-b961-537152a38e90 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:06.675398 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-938e2d76-797e-4aff-b961-537152a38e90 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:06.679806 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-60922160-8353-4a1f-9825-f98dbaa57616 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:06.680297 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-60922160-8353-4a1f-9825-f98dbaa57616 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:06.681078 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-60922160-8353-4a1f-9825-f98dbaa57616 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:06.681541 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-60922160-8353-4a1f-9825-f98dbaa57616 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:06.681891 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-938e2d76-797e-4aff-b961-537152a38e90 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:06.682394 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-938e2d76-797e-4aff-b961-537152a38e90 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:06.683308 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-938e2d76-797e-4aff-b961-537152a38e90 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:06.684369 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-938e2d76-797e-4aff-b961-537152a38e90 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:06.688461 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=100 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:59:06.874108 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-60922160-8353-4a1f-9825-f98dbaa57616 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:06.881529 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-60922160-8353-4a1f-9825-f98dbaa57616 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775" status: 200 len: 1496 microversion: 2.1 time: 0.214854 Jul 29 11:59:06.882092 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 502/990] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:06 2022] GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 => generated 1496 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:59:06.887573 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-938e2d76-797e-4aff-b961-537152a38e90 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:06.895167 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-938e2d76-797e-4aff-b961-537152a38e90 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1265 microversion: 2.1 time: 0.224237 Jul 29 11:59:06.895739 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 489/991] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:06 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 11:59:07.314401 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-d3b793d9-8f13-409e-8f5e-5012692e723a tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:07.314929 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d3b793d9-8f13-409e-8f5e-5012692e723a tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:07.320921 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d3b793d9-8f13-409e-8f5e-5012692e723a tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:07.321377 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d3b793d9-8f13-409e-8f5e-5012692e723a tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:07.322168 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d3b793d9-8f13-409e-8f5e-5012692e723a tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:07.322630 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-d3b793d9-8f13-409e-8f5e-5012692e723a tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:07.347619 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-d3b793d9-8f13-409e-8f5e-5012692e723a tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Going to try to terminate instance {{(pid=129584) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 11:59:07.421903 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-d3b793d9-8f13-409e-8f5e-5012692e723a tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775" status: 204 len: 0 microversion: 2.1 time: 0.110926 Jul 29 11:59:07.422491 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 503/992] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 11:59:07 2022] DELETE /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 11:59:07.430911 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-28525b4d-d907-41cd-a064-c9cfedf47a83 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:07.431530 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-28525b4d-d907-41cd-a064-c9cfedf47a83 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:07.437605 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-28525b4d-d907-41cd-a064-c9cfedf47a83 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:07.438065 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-28525b4d-d907-41cd-a064-c9cfedf47a83 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:07.438831 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-28525b4d-d907-41cd-a064-c9cfedf47a83 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:07.439272 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-28525b4d-d907-41cd-a064-c9cfedf47a83 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:07.567411 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-28525b4d-d907-41cd-a064-c9cfedf47a83 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:07.575412 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-28525b4d-d907-41cd-a064-c9cfedf47a83 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775" status: 200 len: 1502 microversion: 2.1 time: 0.148383 Jul 29 11:59:07.575975 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 490/993] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:07 2022] GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:59:07.916607 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-9114a4f3-b96b-449f-9060-ee253d7cba9a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:07.917320 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-9114a4f3-b96b-449f-9060-ee253d7cba9a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:07.924047 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9114a4f3-b96b-449f-9060-ee253d7cba9a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:07.924506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9114a4f3-b96b-449f-9060-ee253d7cba9a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:07.925282 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9114a4f3-b96b-449f-9060-ee253d7cba9a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:07.925749 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-9114a4f3-b96b-449f-9060-ee253d7cba9a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:08.063416 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-9114a4f3-b96b-449f-9060-ee253d7cba9a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:08.070958 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-9114a4f3-b96b-449f-9060-ee253d7cba9a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1265 microversion: 2.1 time: 0.159214 Jul 29 11:59:08.071516 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 504/994] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:07 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:59:08.596774 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-0b108068-54fe-4086-9a36-d533948b6997 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:08.597333 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-0b108068-54fe-4086-9a36-d533948b6997 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:08.599619 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 11:59:08.604954 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0b108068-54fe-4086-9a36-d533948b6997 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:08.606066 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0b108068-54fe-4086-9a36-d533948b6997 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:08.606827 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0b108068-54fe-4086-9a36-d533948b6997 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:08.607265 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-0b108068-54fe-4086-9a36-d533948b6997 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:08.735047 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-0b108068-54fe-4086-9a36-d533948b6997 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:08.742471 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-0b108068-54fe-4086-9a36-d533948b6997 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775" status: 200 len: 1502 microversion: 2.1 time: 0.149662 Jul 29 11:59:08.743030 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 491/995] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:08 2022] GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:59:09.092310 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-fb33793f-c359-4e77-aee1-6d1e24b440b3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:09.092968 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-fb33793f-c359-4e77-aee1-6d1e24b440b3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:09.100234 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fb33793f-c359-4e77-aee1-6d1e24b440b3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:09.100687 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fb33793f-c359-4e77-aee1-6d1e24b440b3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:09.101491 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fb33793f-c359-4e77-aee1-6d1e24b440b3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:09.101936 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fb33793f-c359-4e77-aee1-6d1e24b440b3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:09.235818 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-fb33793f-c359-4e77-aee1-6d1e24b440b3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:09.243508 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-fb33793f-c359-4e77-aee1-6d1e24b440b3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1265 microversion: 2.1 time: 0.155217 Jul 29 11:59:09.244276 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 505/996] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:09 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:59:09.465760 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-e0e83d70-8859-4733-b273-26b7b7c5f1eb req-bf700e79-6f1b-4b00-8762-0dea52e44c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d7fca80-ac19-4168-a7a5-d81c33e85775", "name": "network-vif-deleted", "tag": "859b9d5d-52e3-499e-a74a-28a9f442fba2"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:59:09.478490 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-e0e83d70-8859-4733-b273-26b7b7c5f1eb req-bf700e79-6f1b-4b00-8762-0dea52e44c86 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:09.479158 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-e0e83d70-8859-4733-b273-26b7b7c5f1eb req-bf700e79-6f1b-4b00-8762-0dea52e44c86 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:09.492520 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-e0e83d70-8859-4733-b273-26b7b7c5f1eb req-bf700e79-6f1b-4b00-8762-0dea52e44c86 service nova] Creating event network-vif-deleted:859b9d5d-52e3-499e-a74a-28a9f442fba2 for instance 1d7fca80-ac19-4168-a7a5-d81c33e85775 on hv-cinder-83754 Jul 29 11:59:09.498962 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-e0e83d70-8859-4733-b273-26b7b7c5f1eb req-bf700e79-6f1b-4b00-8762-0dea52e44c86 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037176 Jul 29 11:59:09.499581 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 492/997] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:59:09.763272 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-18bec31b-d583-4e47-aa56-e2ac5e9f6d0d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:09.763877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-18bec31b-d583-4e47-aa56-e2ac5e9f6d0d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:09.769938 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-18bec31b-d583-4e47-aa56-e2ac5e9f6d0d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:09.770390 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-18bec31b-d583-4e47-aa56-e2ac5e9f6d0d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:09.771162 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-18bec31b-d583-4e47-aa56-e2ac5e9f6d0d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:09.771597 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-18bec31b-d583-4e47-aa56-e2ac5e9f6d0d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:09.803332 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-18bec31b-d583-4e47-aa56-e2ac5e9f6d0d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:09.803780 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-18bec31b-d583-4e47-aa56-e2ac5e9f6d0d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:09.804248 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.objects.instance [None req-18bec31b-d583-4e47-aa56-e2ac5e9f6d0d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lazy-loading 'fault' on Instance uuid 1d7fca80-ac19-4168-a7a5-d81c33e85775 {{(pid=129584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 11:59:09.845731 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-18bec31b-d583-4e47-aa56-e2ac5e9f6d0d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7531d3cff80c4c889c7ca3bcaab3afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aa577ac9bf45a49209c232a2237b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:09.854785 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-18bec31b-d583-4e47-aa56-e2ac5e9f6d0d tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775" status: 200 len: 1303 microversion: 2.1 time: 0.095515 Jul 29 11:59:09.856274 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 506/998] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:09 2022] GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:59:09.912895 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-6410df60-2976-4f30-ad62-0db2005fd544 req-9d98128f-5c82-4dff-ba7b-363bc25d2362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131", "name": "network-vif-plugged", "status": "completed", "tag": "99107bc0-ee01-47c9-bc6e-90d9cc0f9dc0"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:59:09.925720 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-6410df60-2976-4f30-ad62-0db2005fd544 req-9d98128f-5c82-4dff-ba7b-363bc25d2362 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:09.926380 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-6410df60-2976-4f30-ad62-0db2005fd544 req-9d98128f-5c82-4dff-ba7b-363bc25d2362 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:09.938447 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-6410df60-2976-4f30-ad62-0db2005fd544 req-9d98128f-5c82-4dff-ba7b-363bc25d2362 service nova] Creating event network-vif-plugged:99107bc0-ee01-47c9-bc6e-90d9cc0f9dc0 for instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 on hv-cinder-83754 Jul 29 11:59:09.943500 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-6410df60-2976-4f30-ad62-0db2005fd544 req-9d98128f-5c82-4dff-ba7b-363bc25d2362 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034721 Jul 29 11:59:09.944178 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 493/999] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 11:59:10.264413 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-78ee6db2-fcf6-439b-bf06-153ab508e483 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:10.265021 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-78ee6db2-fcf6-439b-bf06-153ab508e483 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:10.270963 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-78ee6db2-fcf6-439b-bf06-153ab508e483 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:10.271412 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-78ee6db2-fcf6-439b-bf06-153ab508e483 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:10.272174 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-78ee6db2-fcf6-439b-bf06-153ab508e483 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:10.272604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-78ee6db2-fcf6-439b-bf06-153ab508e483 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:10.403591 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-78ee6db2-fcf6-439b-bf06-153ab508e483 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:10.411131 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-78ee6db2-fcf6-439b-bf06-153ab508e483 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1265 microversion: 2.1 time: 0.151247 Jul 29 11:59:10.411696 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 507/1000] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:10 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:59:10.878225 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c07b4844-1199-4459-af6e-13aad6876cc4 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:10.878927 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-c07b4844-1199-4459-af6e-13aad6876cc4 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] [instance: 1d7fca80-ac19-4168-a7a5-d81c33e85775] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:10.885097 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c07b4844-1199-4459-af6e-13aad6876cc4 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:10.885575 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c07b4844-1199-4459-af6e-13aad6876cc4 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:10.886329 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c07b4844-1199-4459-af6e-13aad6876cc4 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:10.887787 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-c07b4844-1199-4459-af6e-13aad6876cc4 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:10.900757 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-c07b4844-1199-4459-af6e-13aad6876cc4 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] HTTP exception thrown: Instance 1d7fca80-ac19-4168-a7a5-d81c33e85775 could not be found. Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c07b4844-1199-4459-af6e-13aad6876cc4 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Request method failure captured: Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 HTTP/1.1 Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48tsRLFjWiwiKMGXZoL4xzfEgBPfn397mBM-SoA8Nl7sOepDUoHZRr6-41vqG3TXjk32meGKThupLCwr2BPbu-BhPZVxLmtC9mYdSn6rrGxRohe4GQAUlwC5GQszcj3uPsLaIDyXLv1VED80AH_nS5Ab1uy06YNZgoHj4EBqqwAZ4Ig Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 91aa577ac9bf45a49209c232a2237b81 Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-VolumesActionsTest-2088256358 Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 11:59:10.902440 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 11:59:10.904145 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91aa577ac9bf45a49209c232a2237b81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_91aa577ac9bf45a49209c232a2237b81", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/91aa577ac9bf45a49209c232a2237b81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91aa577ac9bf45a49209c232a2237b81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 11:59:10.904145 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-VolumesActionsTest-2088256358 Jul 29 11:59:10.904145 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 91aa577ac9bf45a49209c232a2237b81 Jul 29 11:59:10.904145 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-VolumesActionsTest-2088256358 Jul 29 11:59:10.904145 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-VolumesActionsTest-2088256358-project Jul 29 11:59:10.904145 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 11:59:10.904145 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 11:59:10.904145 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 7531d3cff80c4c889c7ca3bcaab3afcf Jul 29 11:59:10.904145 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-VolumesActionsTest-2088256358-project Jul 29 11:59:10.904145 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 11:59:10.904145 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance 1d7fca80-ac19-4168-a7a5-d81c33e85775 could not be found. Jul 29 11:59:10.904145 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': '1d7fca80-ac19-4168-a7a5-d81c33e85775'} Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d7fca80-ac19-4168-a7a5-d81c33e85775 could not be found. Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 11:59:10.905228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d7fca80-ac19-4168-a7a5-d81c33e85775 could not be found. Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d7fca80-ac19-4168-a7a5-d81c33e85775 could not be found. Jul 29 11:59:10.906947 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 11:59:10.908506 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-c07b4844-1199-4459-af6e-13aad6876cc4 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] Returning 404 to user: Instance 1d7fca80-ac19-4168-a7a5-d81c33e85775 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 11:59:10.908506 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-c07b4844-1199-4459-af6e-13aad6876cc4 tempest-VolumesActionsTest-2088256358 tempest-VolumesActionsTest-2088256358-project] 10.222.0.60 "GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775" status: 404 len: 111 microversion: 2.1 time: 0.029875 Jul 29 11:59:10.908506 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 494/1001] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:10 2022] GET /compute/v2.1/servers/1d7fca80-ac19-4168-a7a5-d81c33e85775 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 11:59:11.431861 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-3b33e4f1-8691-4183-821d-e55335a81796 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:11.432485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-3b33e4f1-8691-4183-821d-e55335a81796 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:11.440442 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3b33e4f1-8691-4183-821d-e55335a81796 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:11.440977 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3b33e4f1-8691-4183-821d-e55335a81796 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:11.441932 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3b33e4f1-8691-4183-821d-e55335a81796 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:11.442387 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-3b33e4f1-8691-4183-821d-e55335a81796 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:11.584409 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-3b33e4f1-8691-4183-821d-e55335a81796 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:11.592910 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-3b33e4f1-8691-4183-821d-e55335a81796 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1265 microversion: 2.1 time: 0.165124 Jul 29 11:59:11.593502 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 508/1002] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:11 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:59:12.613636 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e5a22c0d-e1ff-490f-b15e-da425e7fe968 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:12.614180 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e5a22c0d-e1ff-490f-b15e-da425e7fe968 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:12.620246 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e5a22c0d-e1ff-490f-b15e-da425e7fe968 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:12.620703 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e5a22c0d-e1ff-490f-b15e-da425e7fe968 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:12.621498 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e5a22c0d-e1ff-490f-b15e-da425e7fe968 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:12.621943 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e5a22c0d-e1ff-490f-b15e-da425e7fe968 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:12.753994 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e5a22c0d-e1ff-490f-b15e-da425e7fe968 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:12.762470 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e5a22c0d-e1ff-490f-b15e-da425e7fe968 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1451 microversion: 2.1 time: 0.152172 Jul 29 11:59:12.763122 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 495/1003] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:12 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:59:12.782915 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ec4cb3c8-c4a9-4b56-b6c5-68d6e86b3838 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 11:59:12.783563 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ec4cb3c8-c4a9-4b56-b6c5-68d6e86b3838 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 11:59:12.789986 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ec4cb3c8-c4a9-4b56-b6c5-68d6e86b3838 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:12.790448 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ec4cb3c8-c4a9-4b56-b6c5-68d6e86b3838 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:12.791215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ec4cb3c8-c4a9-4b56-b6c5-68d6e86b3838 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:12.791679 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ec4cb3c8-c4a9-4b56-b6c5-68d6e86b3838 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:12.924263 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-ec4cb3c8-c4a9-4b56-b6c5-68d6e86b3838 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 11:59:12.931743 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ec4cb3c8-c4a9-4b56-b6c5-68d6e86b3838 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1451 microversion: 2.1 time: 0.152762 Jul 29 11:59:12.932297 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 509/1004] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 11:59:12 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 11:59:14.671915 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-e20287b7-afa7-42f6-bff9-f1f48acdce29 req-a3e8baa8-8226-4da0-9eb1-fa8b74fda961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131", "tag": "99107bc0-ee01-47c9-bc6e-90d9cc0f9dc0"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 11:59:14.681335 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-e20287b7-afa7-42f6-bff9-f1f48acdce29 req-a3e8baa8-8226-4da0-9eb1-fa8b74fda961 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 11:59:14.681824 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-e20287b7-afa7-42f6-bff9-f1f48acdce29 req-a3e8baa8-8226-4da0-9eb1-fa8b74fda961 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 11:59:14.693335 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-e20287b7-afa7-42f6-bff9-f1f48acdce29 req-a3e8baa8-8226-4da0-9eb1-fa8b74fda961 service nova] Creating event network-changed:99107bc0-ee01-47c9-bc6e-90d9cc0f9dc0 for instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 on hv-cinder-83754 Jul 29 11:59:14.698327 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-e20287b7-afa7-42f6-bff9-f1f48acdce29 req-a3e8baa8-8226-4da0-9eb1-fa8b74fda961 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087761 Jul 29 11:59:14.699087 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 496/1005] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 11:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:01:21.032872 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR oslo.messaging._drivers.impl_rabbit [-] [08046b0a-11a3-42bb-8ef6-c3f81b5b2460] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 29 12:01:21.033846 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:01:21.034610 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:01:21.038591 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ab61c79a-64b0-411f-88ee-9e931976f1ed tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:21.039098 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ab61c79a-64b0-411f-88ee-9e931976f1ed tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:21.046490 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ab61c79a-64b0-411f-88ee-9e931976f1ed tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:21.046948 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ab61c79a-64b0-411f-88ee-9e931976f1ed tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:21.047725 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ab61c79a-64b0-411f-88ee-9e931976f1ed tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:21.048165 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ab61c79a-64b0-411f-88ee-9e931976f1ed tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:21.074683 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ab61c79a-64b0-411f-88ee-9e931976f1ed tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Going to try to terminate instance {{(pid=129584) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:01:21.148266 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ab61c79a-64b0-411f-88ee-9e931976f1ed tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 204 len: 0 microversion: 2.1 time: 0.117103 Jul 29 12:01:21.148759 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 510/1006] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 12:01:21 2022] DELETE /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 12:01:21.156080 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4b828316-4bc6-4038-8bc5-8f7a0da3318c] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 12:01:21.156646 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=11 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:01:21.157757 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=30 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:01:21.162395 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a2fd1f88-128b-45f5-a5d2-485d50f6f387 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:21.163103 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a2fd1f88-128b-45f5-a5d2-485d50f6f387 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:21.170471 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a2fd1f88-128b-45f5-a5d2-485d50f6f387 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:21.170926 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a2fd1f88-128b-45f5-a5d2-485d50f6f387 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:21.171697 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a2fd1f88-128b-45f5-a5d2-485d50f6f387 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:21.172138 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a2fd1f88-128b-45f5-a5d2-485d50f6f387 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:21.456123 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a2fd1f88-128b-45f5-a5d2-485d50f6f387 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:21.463650 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a2fd1f88-128b-45f5-a5d2-485d50f6f387 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1575 microversion: 2.1 time: 0.309607 Jul 29 12:01:21.464221 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 497/1007] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:21 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1575 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:22.484798 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-bbd32a5e-ecf5-45c1-81e2-01eb8e44fd3f tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:22.485438 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-bbd32a5e-ecf5-45c1-81e2-01eb8e44fd3f tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:22.494471 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bbd32a5e-ecf5-45c1-81e2-01eb8e44fd3f tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:22.494926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bbd32a5e-ecf5-45c1-81e2-01eb8e44fd3f tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:22.495826 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bbd32a5e-ecf5-45c1-81e2-01eb8e44fd3f tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:22.496278 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bbd32a5e-ecf5-45c1-81e2-01eb8e44fd3f tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:22.502777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO oslo.messaging._drivers.impl_rabbit [-] [08046b0a-11a3-42bb-8ef6-c3f81b5b2460] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48298. Jul 29 12:01:22.686294 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bbd32a5e-ecf5-45c1-81e2-01eb8e44fd3f tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:22.693773 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-bbd32a5e-ecf5-45c1-81e2-01eb8e44fd3f tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1575 microversion: 2.1 time: 0.213328 Jul 29 12:01:22.694332 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 511/1008] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:22 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1575 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:23.716096 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-a2aad7cb-bb23-4d4c-bf46-b9fe2d077bdc tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:23.716931 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-a2aad7cb-bb23-4d4c-bf46-b9fe2d077bdc tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:23.724439 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a2aad7cb-bb23-4d4c-bf46-b9fe2d077bdc tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:23.724899 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a2aad7cb-bb23-4d4c-bf46-b9fe2d077bdc tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:23.725704 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a2aad7cb-bb23-4d4c-bf46-b9fe2d077bdc tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:23.726143 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-a2aad7cb-bb23-4d4c-bf46-b9fe2d077bdc tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:23.733120 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO oslo.messaging._drivers.impl_rabbit [-] [4b828316-4bc6-4038-8bc5-8f7a0da3318c] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48304. Jul 29 12:01:23.792877 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-a2aad7cb-bb23-4d4c-bf46-b9fe2d077bdc tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:23.801701 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-a2aad7cb-bb23-4d4c-bf46-b9fe2d077bdc tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 200 len: 1508 microversion: 2.1 time: 0.089997 Jul 29 12:01:23.803093 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 498/1009] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:23 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 1508 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:23.826116 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-6597b8c0-3cf8-4178-8268-5cc6ddecffc1 req-95122563-7961-417b-aa2f-37d48cf5d6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131", "name": "network-vif-deleted", "tag": "99107bc0-ee01-47c9-bc6e-90d9cc0f9dc0"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:01:23.836543 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-6597b8c0-3cf8-4178-8268-5cc6ddecffc1 req-95122563-7961-417b-aa2f-37d48cf5d6e5 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:23.837094 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-6597b8c0-3cf8-4178-8268-5cc6ddecffc1 req-95122563-7961-417b-aa2f-37d48cf5d6e5 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:23.850367 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-6597b8c0-3cf8-4178-8268-5cc6ddecffc1 req-95122563-7961-417b-aa2f-37d48cf5d6e5 service nova] Creating event network-vif-deleted:99107bc0-ee01-47c9-bc6e-90d9cc0f9dc0 for instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 on hv-cinder-83754 Jul 29 12:01:23.855106 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-6597b8c0-3cf8-4178-8268-5cc6ddecffc1 req-95122563-7961-417b-aa2f-37d48cf5d6e5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033464 Jul 29 12:01:23.855788 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 512/1010] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 12:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:01:24.824124 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-56dc898d-20d6-4151-9781-17b39c371bc7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:24.825301 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-56dc898d-20d6-4151-9781-17b39c371bc7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:24.833136 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-56dc898d-20d6-4151-9781-17b39c371bc7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:24.833632 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-56dc898d-20d6-4151-9781-17b39c371bc7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:24.834411 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-56dc898d-20d6-4151-9781-17b39c371bc7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:24.834852 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-56dc898d-20d6-4151-9781-17b39c371bc7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:24.849034 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-56dc898d-20d6-4151-9781-17b39c371bc7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] HTTP exception thrown: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-56dc898d-20d6-4151-9781-17b39c371bc7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Request method failure captured: Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 HTTP/1.1 Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48tlTMWHn89BA2FxrwOAl6-QNLJieighQOiUUq2xzGstj7yIGuSiEf9yrfM61bGeJepoyf6BplrbddwukEnRH9edCjU_Cglq7_nheI6ATb6ZKzZeYODMDEwrmFTnEOPEFkFoW6CVpOgw5YeZoYEhCZN7DIyMGvkJidhswmwDPvFQs1Q Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 50680cfc97cf41c18d074cb84493cde7 Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-TestVolumeBootPattern-1045281 Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 12:01:24.850712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 12:01:24.852348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50680cfc97cf41c18d074cb84493cde7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50680cfc97cf41c18d074cb84493cde7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50680cfc97cf41c18d074cb84493cde7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50680cfc97cf41c18d074cb84493cde7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 12:01:24.852348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-TestVolumeBootPattern-1045281 Jul 29 12:01:24.852348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 50680cfc97cf41c18d074cb84493cde7 Jul 29 12:01:24.852348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-TestVolumeBootPattern-1045281 Jul 29 12:01:24.852348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-TestVolumeBootPattern-1045281-project Jul 29 12:01:24.852348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 12:01:24.852348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 12:01:24.852348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 5f9d278bd76c4ce0b90b8307b3c7d1f2 Jul 29 12:01:24.852348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-TestVolumeBootPattern-1045281-project Jul 29 12:01:24.852348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 12:01:24.852348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. Jul 29 12:01:24.852348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': 'cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131'} Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:01:24.853297 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. Jul 29 12:01:24.854699 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 12:01:24.856582 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-56dc898d-20d6-4151-9781-17b39c371bc7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Returning 404 to user: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:01:24.856582 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-56dc898d-20d6-4151-9781-17b39c371bc7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 404 len: 111 microversion: 2.1 time: 0.031980 Jul 29 12:01:24.856582 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 499/1011] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:24 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:01:24.948476 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-ea59f0ae-fcc7-4c82-8b20-5bffed62e356 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-972593276", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1597632429", "security_groups": [{"name": "tempest-secgroup-smoke-225531464"}], "block_device_mapping_v2": [{"uuid": "a6f3d38b-2fd5-4a70-a5fb-772e93f62fa4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2c64f75-d35e-4ef4-8a4c-54a037caa5bc"}]}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:01:25.062786 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.network.neutron [None req-ea59f0ae-fcc7-4c82-8b20-5bffed62e356 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] validate_networks() for [('b2c64f75-d35e-4ef4-8a4c-54a037caa5bc', None, None, None, None, None)] {{(pid=129584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:01:25.716751 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-ea59f0ae-fcc7-4c82-8b20-5bffed62e356 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Flavor limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:01:25.717202 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-ea59f0ae-fcc7-4c82-8b20-5bffed62e356 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Image limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:01:25.717707 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-ea59f0ae-fcc7-4c82-8b20-5bffed62e356 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Flavor pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:01:25.718121 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-ea59f0ae-fcc7-4c82-8b20-5bffed62e356 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Image pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:01:25.718540 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-ea59f0ae-fcc7-4c82-8b20-5bffed62e356 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:01:25.727369 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ea59f0ae-fcc7-4c82-8b20-5bffed62e356 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:25.727820 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ea59f0ae-fcc7-4c82-8b20-5bffed62e356 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:25.728615 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ea59f0ae-fcc7-4c82-8b20-5bffed62e356 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:25.729062 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-ea59f0ae-fcc7-4c82-8b20-5bffed62e356 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:25.745974 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-ea59f0ae-fcc7-4c82-8b20-5bffed62e356 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Getting quotas for project 50680cfc97cf41c18d074cb84493cde7. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:01:25.749851 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-ea59f0ae-fcc7-4c82-8b20-5bffed62e356 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Getting quotas for user 5f9d278bd76c4ce0b90b8307b3c7d1f2 and project 50680cfc97cf41c18d074cb84493cde7. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:01:25.807554 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ea59f0ae-fcc7-4c82-8b20-5bffed62e356 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Going to run 1 instances... {{(pid=129584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:01:25.809766 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-ea59f0ae-fcc7-4c82-8b20-5bffed62e356 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6f3d38b-2fd5-4a70-a5fb-772e93f62fa4',volume_size=None,volume_type=None)] {{(pid=129584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:01:25.939599 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-ea59f0ae-fcc7-4c82-8b20-5bffed62e356 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.995910 Jul 29 12:01:25.940241 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 513/1012] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 12:01:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 12:01:25.951690 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-327fed2c-d91a-44dc-a6ea-c225da726a69 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:25.952409 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-327fed2c-d91a-44dc-a6ea-c225da726a69 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:26.010564 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-327fed2c-d91a-44dc-a6ea-c225da726a69 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:26.018085 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-327fed2c-d91a-44dc-a6ea-c225da726a69 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1094 microversion: 2.1 time: 0.070779 Jul 29 12:01:26.018653 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 500/1013] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:25 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:27.040855 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-534b0531-eae8-423f-9404-1029786cb606 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:27.041750 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-534b0531-eae8-423f-9404-1029786cb606 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:27.049214 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-534b0531-eae8-423f-9404-1029786cb606 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:27.049850 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-534b0531-eae8-423f-9404-1029786cb606 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:27.050710 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-534b0531-eae8-423f-9404-1029786cb606 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:27.051235 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-534b0531-eae8-423f-9404-1029786cb606 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:27.118224 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-534b0531-eae8-423f-9404-1029786cb606 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:27.126720 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-534b0531-eae8-423f-9404-1029786cb606 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1210 microversion: 2.1 time: 0.090759 Jul 29 12:01:27.127292 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 514/1014] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:27 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:28.148154 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-f800609b-9e26-4196-b596-b226a4c76a42 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:28.148824 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-f800609b-9e26-4196-b596-b226a4c76a42 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:28.157135 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f800609b-9e26-4196-b596-b226a4c76a42 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:28.157697 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f800609b-9e26-4196-b596-b226a4c76a42 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:28.158477 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f800609b-9e26-4196-b596-b226a4c76a42 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:28.158917 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-f800609b-9e26-4196-b596-b226a4c76a42 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:28.272629 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-aef71957-fb6e-47da-8401-8c5c756f5625 req-58dccb45-d8f8-4698-a75e-0c5dea87c74e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea055ff0-9a59-45aa-abbf-a283fdea0616", "tag": "e3f20048-10dc-4804-a4f8-bdf5a8ea8988"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:01:28.295679 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-aef71957-fb6e-47da-8401-8c5c756f5625 req-58dccb45-d8f8-4698-a75e-0c5dea87c74e service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:28.296543 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-aef71957-fb6e-47da-8401-8c5c756f5625 req-58dccb45-d8f8-4698-a75e-0c5dea87c74e service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:28.317258 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-f800609b-9e26-4196-b596-b226a4c76a42 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:28.321929 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-aef71957-fb6e-47da-8401-8c5c756f5625 req-58dccb45-d8f8-4698-a75e-0c5dea87c74e service nova] Creating event network-changed:e3f20048-10dc-4804-a4f8-bdf5a8ea8988 for instance ea055ff0-9a59-45aa-abbf-a283fdea0616 on hv-cinder-83754 Jul 29 12:01:28.328007 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-aef71957-fb6e-47da-8401-8c5c756f5625 req-58dccb45-d8f8-4698-a75e-0c5dea87c74e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061291 Jul 29 12:01:28.329612 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-f800609b-9e26-4196-b596-b226a4c76a42 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1265 microversion: 2.1 time: 0.185280 Jul 29 12:01:28.329765 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 515/1015] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 12:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:01:28.330510 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 501/1016] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:28 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:29.354268 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-fae12d21-907d-4950-90a0-94f5a4946f78 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:29.354988 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-fae12d21-907d-4950-90a0-94f5a4946f78 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:29.362814 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fae12d21-907d-4950-90a0-94f5a4946f78 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:29.363271 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fae12d21-907d-4950-90a0-94f5a4946f78 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:29.364061 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fae12d21-907d-4950-90a0-94f5a4946f78 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:29.364498 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fae12d21-907d-4950-90a0-94f5a4946f78 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:29.509660 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-fae12d21-907d-4950-90a0-94f5a4946f78 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:29.518444 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-fae12d21-907d-4950-90a0-94f5a4946f78 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1265 microversion: 2.1 time: 0.168505 Jul 29 12:01:29.519033 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 516/1017] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:29 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:30.540928 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-de6877b4-7da3-4622-b545-df47ed1ef637 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:30.541807 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-de6877b4-7da3-4622-b545-df47ed1ef637 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:30.549314 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-de6877b4-7da3-4622-b545-df47ed1ef637 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:30.549804 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-de6877b4-7da3-4622-b545-df47ed1ef637 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:30.550586 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-de6877b4-7da3-4622-b545-df47ed1ef637 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:30.551032 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-de6877b4-7da3-4622-b545-df47ed1ef637 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:30.694539 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-de6877b4-7da3-4622-b545-df47ed1ef637 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:30.705756 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-de6877b4-7da3-4622-b545-df47ed1ef637 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1265 microversion: 2.1 time: 0.169835 Jul 29 12:01:30.706674 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 502/1018] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:30 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:31.477567 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 12:01:31.478099 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Fri Jul 29 12:01:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 12:01:31.729252 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-628316d0-146d-4ce7-95f8-31d1fa630bbe tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:31.729817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-628316d0-146d-4ce7-95f8-31d1fa630bbe tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:31.737003 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-628316d0-146d-4ce7-95f8-31d1fa630bbe tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:31.737485 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-628316d0-146d-4ce7-95f8-31d1fa630bbe tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:31.738251 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-628316d0-146d-4ce7-95f8-31d1fa630bbe tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:31.738688 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-628316d0-146d-4ce7-95f8-31d1fa630bbe tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:31.867260 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-628316d0-146d-4ce7-95f8-31d1fa630bbe tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:31.874931 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-628316d0-146d-4ce7-95f8-31d1fa630bbe tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1265 microversion: 2.1 time: 0.149618 Jul 29 12:01:31.875494 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 517/1019] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:31 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:32.895868 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-6d403d4b-ec21-4267-8062-ef6643f0d22e tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:32.896524 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-6d403d4b-ec21-4267-8062-ef6643f0d22e tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:32.903022 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6d403d4b-ec21-4267-8062-ef6643f0d22e tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:32.903476 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6d403d4b-ec21-4267-8062-ef6643f0d22e tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:32.904240 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6d403d4b-ec21-4267-8062-ef6643f0d22e tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:32.904677 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-6d403d4b-ec21-4267-8062-ef6643f0d22e tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:33.037256 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-6d403d4b-ec21-4267-8062-ef6643f0d22e tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:33.045266 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-6d403d4b-ec21-4267-8062-ef6643f0d22e tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1265 microversion: 2.1 time: 0.153313 Jul 29 12:01:33.045867 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 503/1020] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:32 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:34.066259 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-2c14f9d3-e574-44ff-9805-73dda8a680d0 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:34.066817 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-2c14f9d3-e574-44ff-9805-73dda8a680d0 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:34.073227 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2c14f9d3-e574-44ff-9805-73dda8a680d0 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:34.073710 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2c14f9d3-e574-44ff-9805-73dda8a680d0 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:34.075161 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2c14f9d3-e574-44ff-9805-73dda8a680d0 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:34.075488 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-2c14f9d3-e574-44ff-9805-73dda8a680d0 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:34.207521 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-2c14f9d3-e574-44ff-9805-73dda8a680d0 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:34.215005 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-2c14f9d3-e574-44ff-9805-73dda8a680d0 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1265 microversion: 2.1 time: 0.152682 Jul 29 12:01:34.215743 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 518/1021] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:34 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:35.236851 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-4feb5af7-ed65-455b-b514-2f5e8afb72d6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:35.237512 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-4feb5af7-ed65-455b-b514-2f5e8afb72d6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:35.244102 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4feb5af7-ed65-455b-b514-2f5e8afb72d6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:35.244557 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4feb5af7-ed65-455b-b514-2f5e8afb72d6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:35.245329 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4feb5af7-ed65-455b-b514-2f5e8afb72d6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:35.245808 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-4feb5af7-ed65-455b-b514-2f5e8afb72d6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:35.378812 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-4feb5af7-ed65-455b-b514-2f5e8afb72d6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:35.386340 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-4feb5af7-ed65-455b-b514-2f5e8afb72d6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1265 microversion: 2.1 time: 0.153603 Jul 29 12:01:35.387394 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 504/1022] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:35 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:36.002312 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 12:01:36.002497 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Fri Jul 29 12:01:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 12:01:36.408504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-308700e1-2701-46aa-a799-3b62416cffc3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:36.409115 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-308700e1-2701-46aa-a799-3b62416cffc3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:36.411416 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=2 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:01:36.412065 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=6 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:01:36.417637 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-308700e1-2701-46aa-a799-3b62416cffc3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:36.418083 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-308700e1-2701-46aa-a799-3b62416cffc3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:36.419919 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-308700e1-2701-46aa-a799-3b62416cffc3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:36.419919 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-308700e1-2701-46aa-a799-3b62416cffc3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:36.551295 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-308700e1-2701-46aa-a799-3b62416cffc3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:36.559018 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-308700e1-2701-46aa-a799-3b62416cffc3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1265 microversion: 2.1 time: 0.154273 Jul 29 12:01:36.559519 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 519/1023] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:36 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:37.578337 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ebde148e-356b-4328-a2f4-e04fa4558a63 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:37.578962 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ebde148e-356b-4328-a2f4-e04fa4558a63 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:37.580872 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:01:37.587140 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ebde148e-356b-4328-a2f4-e04fa4558a63 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:37.587602 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ebde148e-356b-4328-a2f4-e04fa4558a63 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:37.588372 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ebde148e-356b-4328-a2f4-e04fa4558a63 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:37.588813 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ebde148e-356b-4328-a2f4-e04fa4558a63 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:37.721954 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ebde148e-356b-4328-a2f4-e04fa4558a63 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:37.729339 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ebde148e-356b-4328-a2f4-e04fa4558a63 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1265 microversion: 2.1 time: 0.155002 Jul 29 12:01:37.729930 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 505/1024] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:37 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:38.650420 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-6af36f08-3a7b-4cda-b08c-11052c1bb036 req-6f89f2fc-19b2-40c9-add9-fb2b8a41f98e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea055ff0-9a59-45aa-abbf-a283fdea0616", "name": "network-vif-plugged", "status": "completed", "tag": "e3f20048-10dc-4804-a4f8-bdf5a8ea8988"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:01:38.660433 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-6af36f08-3a7b-4cda-b08c-11052c1bb036 req-6f89f2fc-19b2-40c9-add9-fb2b8a41f98e service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:38.660842 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-6af36f08-3a7b-4cda-b08c-11052c1bb036 req-6f89f2fc-19b2-40c9-add9-fb2b8a41f98e service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:38.672006 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-6af36f08-3a7b-4cda-b08c-11052c1bb036 req-6f89f2fc-19b2-40c9-add9-fb2b8a41f98e service nova] Creating event network-vif-plugged:e3f20048-10dc-4804-a4f8-bdf5a8ea8988 for instance ea055ff0-9a59-45aa-abbf-a283fdea0616 on hv-cinder-83754 Jul 29 12:01:38.677080 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-6af36f08-3a7b-4cda-b08c-11052c1bb036 req-6f89f2fc-19b2-40c9-add9-fb2b8a41f98e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030349 Jul 29 12:01:38.677854 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 520/1025] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 12:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:01:38.751288 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-94ca63bb-48c6-403a-a7d4-7ecd4bc821cb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:38.751817 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-94ca63bb-48c6-403a-a7d4-7ecd4bc821cb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:38.758423 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-94ca63bb-48c6-403a-a7d4-7ecd4bc821cb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:38.758873 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-94ca63bb-48c6-403a-a7d4-7ecd4bc821cb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:38.759635 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-94ca63bb-48c6-403a-a7d4-7ecd4bc821cb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:38.760071 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-94ca63bb-48c6-403a-a7d4-7ecd4bc821cb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:38.895203 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-94ca63bb-48c6-403a-a7d4-7ecd4bc821cb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:38.902932 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-94ca63bb-48c6-403a-a7d4-7ecd4bc821cb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1265 microversion: 2.1 time: 0.155540 Jul 29 12:01:38.903505 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 506/1026] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:38 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:39.925220 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-c557cde9-93a7-4a03-86eb-83e48175e8b6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:39.925963 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-c557cde9-93a7-4a03-86eb-83e48175e8b6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:39.932233 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c557cde9-93a7-4a03-86eb-83e48175e8b6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:39.932682 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c557cde9-93a7-4a03-86eb-83e48175e8b6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:39.933476 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c557cde9-93a7-4a03-86eb-83e48175e8b6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:39.934595 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-c557cde9-93a7-4a03-86eb-83e48175e8b6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:40.066093 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-c557cde9-93a7-4a03-86eb-83e48175e8b6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:40.073682 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-c557cde9-93a7-4a03-86eb-83e48175e8b6 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1265 microversion: 2.1 time: 0.153537 Jul 29 12:01:40.074235 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 521/1027] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:39 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:41.095629 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-2dc1e907-9d39-455b-9bcd-4f7dd448fbbb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:41.096568 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-2dc1e907-9d39-455b-9bcd-4f7dd448fbbb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:41.103457 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2dc1e907-9d39-455b-9bcd-4f7dd448fbbb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:41.103915 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2dc1e907-9d39-455b-9bcd-4f7dd448fbbb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:41.104693 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2dc1e907-9d39-455b-9bcd-4f7dd448fbbb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:41.105175 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-2dc1e907-9d39-455b-9bcd-4f7dd448fbbb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:41.239192 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-2dc1e907-9d39-455b-9bcd-4f7dd448fbbb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:41.246759 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-2dc1e907-9d39-455b-9bcd-4f7dd448fbbb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1451 microversion: 2.1 time: 0.154999 Jul 29 12:01:41.247317 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 507/1028] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:41 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:41.267087 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-6412dd4d-759a-448e-8ba0-c620b4aa5472 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:01:41.267705 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-6412dd4d-759a-448e-8ba0-c620b4aa5472 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:01:41.274236 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6412dd4d-759a-448e-8ba0-c620b4aa5472 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:41.274694 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6412dd4d-759a-448e-8ba0-c620b4aa5472 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:41.275463 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6412dd4d-759a-448e-8ba0-c620b4aa5472 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:41.275905 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-6412dd4d-759a-448e-8ba0-c620b4aa5472 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:41.413789 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-6412dd4d-759a-448e-8ba0-c620b4aa5472 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:01:41.421274 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-6412dd4d-759a-448e-8ba0-c620b4aa5472 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1451 microversion: 2.1 time: 0.158231 Jul 29 12:01:41.421862 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 522/1029] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:01:41 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:01:43.015674 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-07598e29-a46e-4972-9bcb-988f8eca1f10 req-5eddfb34-ade0-4e7e-9845-91ab26d61ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea055ff0-9a59-45aa-abbf-a283fdea0616", "tag": "e3f20048-10dc-4804-a4f8-bdf5a8ea8988"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:01:43.025929 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-07598e29-a46e-4972-9bcb-988f8eca1f10 req-5eddfb34-ade0-4e7e-9845-91ab26d61ddb service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:01:43.026383 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-07598e29-a46e-4972-9bcb-988f8eca1f10 req-5eddfb34-ade0-4e7e-9845-91ab26d61ddb service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:01:43.038656 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-07598e29-a46e-4972-9bcb-988f8eca1f10 req-5eddfb34-ade0-4e7e-9845-91ab26d61ddb service nova] Creating event network-changed:e3f20048-10dc-4804-a4f8-bdf5a8ea8988 for instance ea055ff0-9a59-45aa-abbf-a283fdea0616 on hv-cinder-83754 Jul 29 12:01:43.044722 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-07598e29-a46e-4972-9bcb-988f8eca1f10 req-5eddfb34-ade0-4e7e-9845-91ab26d61ddb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033169 Jul 29 12:01:43.045495 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 508/1030] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 12:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:03:18.136154 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 12:03:18.136834 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Fri Jul 29 12:03:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 12:03:22.580029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:03:22.580780 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:03:22.585640 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-039163a5-3ae0-4381-bfba-8275105a20a8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-361254063", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1597632429", "security_groups": [{"name": "tempest-secgroup-smoke-225531464"}], "block_device_mapping_v2": [{"uuid": "68bde374-e11d-45cb-a55b-aa9dbb41dff9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2c64f75-d35e-4ef4-8a4c-54a037caa5bc"}]}} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:03:22.701369 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.network.neutron [None req-039163a5-3ae0-4381-bfba-8275105a20a8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] validate_networks() for [('b2c64f75-d35e-4ef4-8a4c-54a037caa5bc', None, None, None, None, None)] {{(pid=129584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:03:23.063340 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-039163a5-3ae0-4381-bfba-8275105a20a8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Flavor limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:03:23.063765 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-039163a5-3ae0-4381-bfba-8275105a20a8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Image limits 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:03:23.064240 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-039163a5-3ae0-4381-bfba-8275105a20a8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Flavor pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:03:23.064677 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-039163a5-3ae0-4381-bfba-8275105a20a8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Image pref 0:0:0 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:03:23.065091 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.virt.hardware [None req-039163a5-3ae0-4381-bfba-8275105a20a8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:03:23.074416 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-039163a5-3ae0-4381-bfba-8275105a20a8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:23.074863 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-039163a5-3ae0-4381-bfba-8275105a20a8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:23.075658 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-039163a5-3ae0-4381-bfba-8275105a20a8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:23.076095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-039163a5-3ae0-4381-bfba-8275105a20a8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:23.093598 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-039163a5-3ae0-4381-bfba-8275105a20a8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Getting quotas for project 50680cfc97cf41c18d074cb84493cde7. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:03:23.097527 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.quota [None req-039163a5-3ae0-4381-bfba-8275105a20a8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Getting quotas for user 5f9d278bd76c4ce0b90b8307b3c7d1f2 and project 50680cfc97cf41c18d074cb84493cde7. Resources: {'instances', 'ram', 'cores'} {{(pid=129584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:03:23.153853 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-039163a5-3ae0-4381-bfba-8275105a20a8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Going to run 1 instances... {{(pid=129584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:03:23.156031 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-039163a5-3ae0-4381-bfba-8275105a20a8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68bde374-e11d-45cb-a55b-aa9dbb41dff9',volume_size=None,volume_type=None)] {{(pid=129584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:03:23.287133 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-039163a5-3ae0-4381-bfba-8275105a20a8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.709667 Jul 29 12:03:23.287776 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 523/1031] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Jul 29 12:03:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 12:03:23.297442 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=26 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:03:23.298188 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=58 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:03:23.302505 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-1060cc02-3efc-447b-b1ef-c87a9738981b tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:03:23.303217 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-1060cc02-3efc-447b-b1ef-c87a9738981b tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:03:23.356949 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-1060cc02-3efc-447b-b1ef-c87a9738981b tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:03:23.364380 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-1060cc02-3efc-447b-b1ef-c87a9738981b tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1094 microversion: 2.1 time: 0.069586 Jul 29 12:03:23.364950 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 509/1032] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:03:23 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:03:24.386956 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-eaf3474e-d64d-48f6-9c41-407eb23bb4bb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:03:24.388313 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-eaf3474e-d64d-48f6-9c41-407eb23bb4bb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:03:24.395739 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-eaf3474e-d64d-48f6-9c41-407eb23bb4bb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:24.396189 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-eaf3474e-d64d-48f6-9c41-407eb23bb4bb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:24.396959 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-eaf3474e-d64d-48f6-9c41-407eb23bb4bb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:24.397393 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-eaf3474e-d64d-48f6-9c41-407eb23bb4bb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:24.465053 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-eaf3474e-d64d-48f6-9c41-407eb23bb4bb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:03:24.473892 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-eaf3474e-d64d-48f6-9c41-407eb23bb4bb tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1210 microversion: 2.1 time: 0.091365 Jul 29 12:03:24.474612 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 524/1033] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:03:24 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:03:25.496111 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-eed99130-7cf5-4c2a-93a4-e150ff76c6aa tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:03:25.496735 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-eed99130-7cf5-4c2a-93a4-e150ff76c6aa tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:03:25.504521 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-eed99130-7cf5-4c2a-93a4-e150ff76c6aa tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:25.504992 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-eed99130-7cf5-4c2a-93a4-e150ff76c6aa tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:25.505814 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-eed99130-7cf5-4c2a-93a4-e150ff76c6aa tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:25.506439 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-eed99130-7cf5-4c2a-93a4-e150ff76c6aa tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:25.644764 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-eed99130-7cf5-4c2a-93a4-e150ff76c6aa tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:03:25.653384 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-eed99130-7cf5-4c2a-93a4-e150ff76c6aa tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1265 microversion: 2.1 time: 0.161932 Jul 29 12:03:25.662119 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 510/1034] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:03:25 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:03:25.736093 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-aa26a4c3-0e1e-4331-b9e3-fba2d69f885d req-74fd56a7-b214-48d4-8d51-a7dd917a86a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9521a52e-c68c-4cff-9911-0f2ccf2fff68", "tag": "7c513e4a-f728-4a0b-8cc7-1ed0e5141836"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:03:25.746681 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-aa26a4c3-0e1e-4331-b9e3-fba2d69f885d req-74fd56a7-b214-48d4-8d51-a7dd917a86a9 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:25.747132 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-aa26a4c3-0e1e-4331-b9e3-fba2d69f885d req-74fd56a7-b214-48d4-8d51-a7dd917a86a9 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:25.759720 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-aa26a4c3-0e1e-4331-b9e3-fba2d69f885d req-74fd56a7-b214-48d4-8d51-a7dd917a86a9 service nova] Creating event network-changed:7c513e4a-f728-4a0b-8cc7-1ed0e5141836 for instance 9521a52e-c68c-4cff-9911-0f2ccf2fff68 on hv-cinder-83754 Jul 29 12:03:25.765155 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-aa26a4c3-0e1e-4331-b9e3-fba2d69f885d req-74fd56a7-b214-48d4-8d51-a7dd917a86a9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110251 Jul 29 12:03:25.767287 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 525/1035] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 12:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:03:26.683043 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-b43928c7-1ce4-400a-8a1a-326afcaa58da tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:03:26.683665 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-b43928c7-1ce4-400a-8a1a-326afcaa58da tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:03:26.690309 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b43928c7-1ce4-400a-8a1a-326afcaa58da tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:26.690771 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b43928c7-1ce4-400a-8a1a-326afcaa58da tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:26.691553 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b43928c7-1ce4-400a-8a1a-326afcaa58da tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:26.691994 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-b43928c7-1ce4-400a-8a1a-326afcaa58da tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:26.826486 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-b43928c7-1ce4-400a-8a1a-326afcaa58da tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:03:26.834857 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-b43928c7-1ce4-400a-8a1a-326afcaa58da tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1265 microversion: 2.1 time: 0.155776 Jul 29 12:03:26.835442 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 511/1036] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:03:26 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:03:27.858729 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-0d48fdb7-e5f3-40f7-a649-6e468eecb12a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:03:27.859701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-0d48fdb7-e5f3-40f7-a649-6e468eecb12a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:03:27.866684 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0d48fdb7-e5f3-40f7-a649-6e468eecb12a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:27.867139 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0d48fdb7-e5f3-40f7-a649-6e468eecb12a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:27.867906 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0d48fdb7-e5f3-40f7-a649-6e468eecb12a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:27.868971 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-0d48fdb7-e5f3-40f7-a649-6e468eecb12a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:28.000586 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-0d48fdb7-e5f3-40f7-a649-6e468eecb12a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:03:28.008474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-0d48fdb7-e5f3-40f7-a649-6e468eecb12a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1265 microversion: 2.1 time: 0.155922 Jul 29 12:03:28.009047 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 526/1037] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:03:27 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:03:29.029348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-794e967c-24a8-4295-a68c-f6792d2d2e0d tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:03:29.029985 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-794e967c-24a8-4295-a68c-f6792d2d2e0d tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:03:29.036425 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-794e967c-24a8-4295-a68c-f6792d2d2e0d tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:29.036816 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-794e967c-24a8-4295-a68c-f6792d2d2e0d tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:29.037611 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-794e967c-24a8-4295-a68c-f6792d2d2e0d tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:29.038044 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-794e967c-24a8-4295-a68c-f6792d2d2e0d tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:29.168812 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-794e967c-24a8-4295-a68c-f6792d2d2e0d tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:03:29.177032 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-794e967c-24a8-4295-a68c-f6792d2d2e0d tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1265 microversion: 2.1 time: 0.151529 Jul 29 12:03:29.177636 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 512/1038] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:03:29 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:03:30.197680 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-752f1c5e-c8ad-4059-8275-7b4691bab63c tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:03:30.198306 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-752f1c5e-c8ad-4059-8275-7b4691bab63c tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:03:30.205107 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-752f1c5e-c8ad-4059-8275-7b4691bab63c tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:30.205503 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-752f1c5e-c8ad-4059-8275-7b4691bab63c tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:30.206510 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-752f1c5e-c8ad-4059-8275-7b4691bab63c tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:30.206926 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-752f1c5e-c8ad-4059-8275-7b4691bab63c tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:30.347292 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-752f1c5e-c8ad-4059-8275-7b4691bab63c tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:03:30.354964 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-752f1c5e-c8ad-4059-8275-7b4691bab63c tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1265 microversion: 2.1 time: 0.161129 Jul 29 12:03:30.355531 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 527/1039] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:03:30 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:03:31.376151 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-36d45037-3631-4b93-aa31-54c0c2b1a682 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:03:31.377348 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-36d45037-3631-4b93-aa31-54c0c2b1a682 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:03:31.383809 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-36d45037-3631-4b93-aa31-54c0c2b1a682 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:31.384259 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-36d45037-3631-4b93-aa31-54c0c2b1a682 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:31.385038 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-36d45037-3631-4b93-aa31-54c0c2b1a682 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:31.385918 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-36d45037-3631-4b93-aa31-54c0c2b1a682 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:31.520263 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-36d45037-3631-4b93-aa31-54c0c2b1a682 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:03:31.527678 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-36d45037-3631-4b93-aa31-54c0c2b1a682 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1265 microversion: 2.1 time: 0.155374 Jul 29 12:03:31.528240 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 513/1040] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:03:31 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:03:32.548651 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-bd33807a-a32d-4520-a112-a7e649cdef91 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:03:32.549258 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-bd33807a-a32d-4520-a112-a7e649cdef91 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:03:32.555750 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bd33807a-a32d-4520-a112-a7e649cdef91 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:32.556203 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bd33807a-a32d-4520-a112-a7e649cdef91 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:32.556966 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bd33807a-a32d-4520-a112-a7e649cdef91 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:32.557402 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bd33807a-a32d-4520-a112-a7e649cdef91 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:32.692426 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bd33807a-a32d-4520-a112-a7e649cdef91 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:03:32.699937 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-bd33807a-a32d-4520-a112-a7e649cdef91 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1265 microversion: 2.1 time: 0.155250 Jul 29 12:03:32.700498 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 528/1041] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:03:32 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:03:33.721492 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8e8451b5-0800-4efe-bcaa-68f6f0d860d3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:03:33.722115 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8e8451b5-0800-4efe-bcaa-68f6f0d860d3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:03:33.724493 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell0:SELECT=2 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:03:33.730355 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8e8451b5-0800-4efe-bcaa-68f6f0d860d3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:33.730805 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8e8451b5-0800-4efe-bcaa-68f6f0d860d3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:33.731569 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8e8451b5-0800-4efe-bcaa-68f6f0d860d3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:33.732030 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8e8451b5-0800-4efe-bcaa-68f6f0d860d3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:33.864340 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-8e8451b5-0800-4efe-bcaa-68f6f0d860d3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:03:33.872216 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8e8451b5-0800-4efe-bcaa-68f6f0d860d3 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1265 microversion: 2.1 time: 0.155268 Jul 29 12:03:33.872782 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 514/1042] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:03:33 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:03:34.894204 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-79583a33-ae06-4710-bbbd-442ac810b275 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:03:34.894816 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-79583a33-ae06-4710-bbbd-442ac810b275 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:03:34.896743 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=2 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:03:34.897523 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell0:SELECT=6 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:03:34.903538 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-79583a33-ae06-4710-bbbd-442ac810b275 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:34.903983 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-79583a33-ae06-4710-bbbd-442ac810b275 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:34.904746 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-79583a33-ae06-4710-bbbd-442ac810b275 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:34.905177 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-79583a33-ae06-4710-bbbd-442ac810b275 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:35.036869 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-79583a33-ae06-4710-bbbd-442ac810b275 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:03:35.044497 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-79583a33-ae06-4710-bbbd-442ac810b275 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1265 microversion: 2.1 time: 0.155069 Jul 29 12:03:35.045070 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 529/1043] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:03:34 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:03:35.180269 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-3575ab87-c226-4a39-8313-adc2269d4a3e req-4c1478ec-4323-4921-b3ba-2e6adf40890f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9521a52e-c68c-4cff-9911-0f2ccf2fff68", "name": "network-vif-plugged", "status": "completed", "tag": "7c513e4a-f728-4a0b-8cc7-1ed0e5141836"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:03:35.194016 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-3575ab87-c226-4a39-8313-adc2269d4a3e req-4c1478ec-4323-4921-b3ba-2e6adf40890f service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:35.194762 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-3575ab87-c226-4a39-8313-adc2269d4a3e req-4c1478ec-4323-4921-b3ba-2e6adf40890f service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:35.206369 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-3575ab87-c226-4a39-8313-adc2269d4a3e req-4c1478ec-4323-4921-b3ba-2e6adf40890f service nova] Creating event network-vif-plugged:7c513e4a-f728-4a0b-8cc7-1ed0e5141836 for instance 9521a52e-c68c-4cff-9911-0f2ccf2fff68 on hv-cinder-83754 Jul 29 12:03:35.211821 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-3575ab87-c226-4a39-8313-adc2269d4a3e req-4c1478ec-4323-4921-b3ba-2e6adf40890f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038908 Jul 29 12:03:35.212420 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 515/1044] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 12:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:03:36.116590 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-bf34c7b9-4ccc-472b-afff-36dc2b8e6a38 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:03:36.117202 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-bf34c7b9-4ccc-472b-afff-36dc2b8e6a38 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:03:36.123182 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bf34c7b9-4ccc-472b-afff-36dc2b8e6a38 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:36.123625 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bf34c7b9-4ccc-472b-afff-36dc2b8e6a38 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:36.124379 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bf34c7b9-4ccc-472b-afff-36dc2b8e6a38 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:36.124806 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-bf34c7b9-4ccc-472b-afff-36dc2b8e6a38 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:36.258873 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-bf34c7b9-4ccc-472b-afff-36dc2b8e6a38 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:03:36.266737 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-bf34c7b9-4ccc-472b-afff-36dc2b8e6a38 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1265 microversion: 2.1 time: 0.205203 Jul 29 12:03:36.267993 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 530/1045] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:03:36 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:03:37.289020 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-ca541439-39b1-4734-a06b-0a49c1a4ea62 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:03:37.289770 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-ca541439-39b1-4734-a06b-0a49c1a4ea62 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:03:37.296544 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ca541439-39b1-4734-a06b-0a49c1a4ea62 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:37.297000 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ca541439-39b1-4734-a06b-0a49c1a4ea62 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:37.297800 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ca541439-39b1-4734-a06b-0a49c1a4ea62 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:37.298252 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-ca541439-39b1-4734-a06b-0a49c1a4ea62 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:37.427404 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-ca541439-39b1-4734-a06b-0a49c1a4ea62 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:03:37.434866 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-ca541439-39b1-4734-a06b-0a49c1a4ea62 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1451 microversion: 2.1 time: 0.150106 Jul 29 12:03:37.435434 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 516/1046] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:03:37 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:03:37.455299 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-29ba950c-c0fb-44c8-b3fa-9e645c4f5911 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:03:37.455852 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-29ba950c-c0fb-44c8-b3fa-9e645c4f5911 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:03:37.462398 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-29ba950c-c0fb-44c8-b3fa-9e645c4f5911 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:37.462855 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-29ba950c-c0fb-44c8-b3fa-9e645c4f5911 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:37.463623 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-29ba950c-c0fb-44c8-b3fa-9e645c4f5911 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:37.464065 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-29ba950c-c0fb-44c8-b3fa-9e645c4f5911 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:37.596016 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-29ba950c-c0fb-44c8-b3fa-9e645c4f5911 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:03:37.603486 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-29ba950c-c0fb-44c8-b3fa-9e645c4f5911 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1451 microversion: 2.1 time: 0.152629 Jul 29 12:03:37.604051 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 531/1047] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:03:37 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:03:39.439664 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-0a8b1edb-a77f-482e-8b6b-00ee416aa228 req-c5a4486e-1ea7-4b59-9286-ea1c0a7b454f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9521a52e-c68c-4cff-9911-0f2ccf2fff68", "tag": "7c513e4a-f728-4a0b-8cc7-1ed0e5141836"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:03:39.449680 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-0a8b1edb-a77f-482e-8b6b-00ee416aa228 req-c5a4486e-1ea7-4b59-9286-ea1c0a7b454f service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:03:39.450199 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-0a8b1edb-a77f-482e-8b6b-00ee416aa228 req-c5a4486e-1ea7-4b59-9286-ea1c0a7b454f service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:03:39.461228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-0a8b1edb-a77f-482e-8b6b-00ee416aa228 req-c5a4486e-1ea7-4b59-9286-ea1c0a7b454f service nova] Creating event network-changed:7c513e4a-f728-4a0b-8cc7-1ed0e5141836 for instance 9521a52e-c68c-4cff-9911-0f2ccf2fff68 on hv-cinder-83754 Jul 29 12:03:39.466593 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-0a8b1edb-a77f-482e-8b6b-00ee416aa228 req-c5a4486e-1ea7-4b59-9286-ea1c0a7b454f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031407 Jul 29 12:03:39.467680 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 517/1048] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 12:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:04:51.486444 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 12:04:51.487003 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Fri Jul 29 12:04:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 12:04:56.010311 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 12:04:56.010850 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Fri Jul 29 12:04:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 12:05:19.296095 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:05:19.297321 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG dbcounter [-] [129584] Writing DB stats nova_cell1:SELECT=46 {{(pid=129584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:05:19.298920 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_api:SELECT=20 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:05:19.300320 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG dbcounter [-] [129585] Writing DB stats nova_cell1:SELECT=40 {{(pid=129585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:05:19.301855 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-17128a8d-3f89-41e9-91db-4cec6715c325 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:05:19.302334 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-17128a8d-3f89-41e9-91db-4cec6715c325 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:05:19.310097 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-17128a8d-3f89-41e9-91db-4cec6715c325 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:19.310815 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-17128a8d-3f89-41e9-91db-4cec6715c325 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:19.311612 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-17128a8d-3f89-41e9-91db-4cec6715c325 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:19.312054 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-17128a8d-3f89-41e9-91db-4cec6715c325 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:19.338827 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-17128a8d-3f89-41e9-91db-4cec6715c325 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Going to try to terminate instance {{(pid=129584) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:05:19.424593 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-17128a8d-3f89-41e9-91db-4cec6715c325 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 204 len: 0 microversion: 2.1 time: 0.130161 Jul 29 12:05:19.425280 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 532/1049] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 12:05:19 2022] DELETE /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 12:05:19.426990 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-a8d8ff38-3ec8-474c-8a41-b1ca90c46b99 req-d139138d-0b8d-4560-b793-6b2ac20506a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9521a52e-c68c-4cff-9911-0f2ccf2fff68", "tag": "7c513e4a-f728-4a0b-8cc7-1ed0e5141836"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:05:19.434526 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-5b2a31fd-55a9-4c2a-9143-dc260218789c tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:05:19.435171 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-5b2a31fd-55a9-4c2a-9143-dc260218789c tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:05:19.441935 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5b2a31fd-55a9-4c2a-9143-dc260218789c tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:19.442520 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5b2a31fd-55a9-4c2a-9143-dc260218789c tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:19.443408 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5b2a31fd-55a9-4c2a-9143-dc260218789c tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:19.443641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-a8d8ff38-3ec8-474c-8a41-b1ca90c46b99 req-d139138d-0b8d-4560-b793-6b2ac20506a3 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:19.444644 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-5b2a31fd-55a9-4c2a-9143-dc260218789c tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:19.444865 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-a8d8ff38-3ec8-474c-8a41-b1ca90c46b99 req-d139138d-0b8d-4560-b793-6b2ac20506a3 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:19.457729 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-a8d8ff38-3ec8-474c-8a41-b1ca90c46b99 req-d139138d-0b8d-4560-b793-6b2ac20506a3 service nova] Creating event network-changed:7c513e4a-f728-4a0b-8cc7-1ed0e5141836 for instance 9521a52e-c68c-4cff-9911-0f2ccf2fff68 on hv-cinder-83754 Jul 29 12:05:19.463753 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-a8d8ff38-3ec8-474c-8a41-b1ca90c46b99 req-d139138d-0b8d-4560-b793-6b2ac20506a3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167001 Jul 29 12:05:19.464536 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 518/1050] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 12:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:05:19.580531 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-5b2a31fd-55a9-4c2a-9143-dc260218789c tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:05:19.588890 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-5b2a31fd-55a9-4c2a-9143-dc260218789c tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1575 microversion: 2.1 time: 0.159167 Jul 29 12:05:19.589684 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 533/1051] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:05:19 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:05:20.611432 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8d3a09f8-7d4d-4ee2-9572-08b0b07b0fff tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:05:20.612066 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8d3a09f8-7d4d-4ee2-9572-08b0b07b0fff tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:05:20.619641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8d3a09f8-7d4d-4ee2-9572-08b0b07b0fff tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:20.620093 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8d3a09f8-7d4d-4ee2-9572-08b0b07b0fff tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:20.620892 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8d3a09f8-7d4d-4ee2-9572-08b0b07b0fff tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:20.621323 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8d3a09f8-7d4d-4ee2-9572-08b0b07b0fff tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:20.752878 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-8d3a09f8-7d4d-4ee2-9572-08b0b07b0fff tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:05:20.761118 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8d3a09f8-7d4d-4ee2-9572-08b0b07b0fff tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1575 microversion: 2.1 time: 0.154077 Jul 29 12:05:20.761707 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 519/1052] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:05:20 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:05:21.782457 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-e6d6d35d-8497-48ef-931f-e9b1b91f5d70 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:05:21.783111 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-e6d6d35d-8497-48ef-931f-e9b1b91f5d70 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:05:21.790313 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e6d6d35d-8497-48ef-931f-e9b1b91f5d70 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:21.790785 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e6d6d35d-8497-48ef-931f-e9b1b91f5d70 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:21.791552 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e6d6d35d-8497-48ef-931f-e9b1b91f5d70 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:21.792000 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-e6d6d35d-8497-48ef-931f-e9b1b91f5d70 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:21.930480 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-e6d6d35d-8497-48ef-931f-e9b1b91f5d70 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:05:21.938843 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-e6d6d35d-8497-48ef-931f-e9b1b91f5d70 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 200 len: 1575 microversion: 2.1 time: 0.160367 Jul 29 12:05:21.939464 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 534/1053] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:05:21 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:05:22.104933 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [req-588ac86f-db9f-4133-9d22-bb2673e063aa req-8dd687a9-4aac-4f92-aafb-1ac056cdf8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9521a52e-c68c-4cff-9911-0f2ccf2fff68", "name": "network-vif-deleted", "tag": "7c513e4a-f728-4a0b-8cc7-1ed0e5141836"}]} {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:05:22.115185 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-588ac86f-db9f-4133-9d22-bb2673e063aa req-8dd687a9-4aac-4f92-aafb-1ac056cdf8f5 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:22.116138 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [req-588ac86f-db9f-4133-9d22-bb2673e063aa req-8dd687a9-4aac-4f92-aafb-1ac056cdf8f5 service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:22.127949 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.compute.server_external_events [req-588ac86f-db9f-4133-9d22-bb2673e063aa req-8dd687a9-4aac-4f92-aafb-1ac056cdf8f5 service nova] Creating event network-vif-deleted:7c513e4a-f728-4a0b-8cc7-1ed0e5141836 for instance 9521a52e-c68c-4cff-9911-0f2ccf2fff68 on hv-cinder-83754 Jul 29 12:05:22.133932 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [req-588ac86f-db9f-4133-9d22-bb2673e063aa req-8dd687a9-4aac-4f92-aafb-1ac056cdf8f5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032638 Jul 29 12:05:22.134568 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 520/1054] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 12:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:05:22.960758 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b6e07a89-c6a7-44a6-a741-e750ffba1bb7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:05:22.961374 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-b6e07a89-c6a7-44a6-a741-e750ffba1bb7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: 9521a52e-c68c-4cff-9911-0f2ccf2fff68] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:05:22.967423 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b6e07a89-c6a7-44a6-a741-e750ffba1bb7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:22.967860 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b6e07a89-c6a7-44a6-a741-e750ffba1bb7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:22.968629 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b6e07a89-c6a7-44a6-a741-e750ffba1bb7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:22.969085 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-b6e07a89-c6a7-44a6-a741-e750ffba1bb7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:22.985765 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-b6e07a89-c6a7-44a6-a741-e750ffba1bb7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] HTTP exception thrown: Instance 9521a52e-c68c-4cff-9911-0f2ccf2fff68 could not be found. Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b6e07a89-c6a7-44a6-a741-e750ffba1bb7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Request method failure captured: Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 HTTP/1.1 Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48tlTMWHn89BA2FxrwOAl6-QNLJieighQOiUUq2xzGstj7yIGuSiEf9yrfM61bGeJepoyf6BplrbddwukEnRH9edCjU_Cglq7_nheI6ATb6ZKzZeYODMDEwrmFTnEOPEFkFoW6CVpOgw5YeZoYEhCZN7DIyMGvkJidhswmwDPvFQs1Q Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 50680cfc97cf41c18d074cb84493cde7 Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-TestVolumeBootPattern-1045281 Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 12:05:22.987777 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 12:05:22.989604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50680cfc97cf41c18d074cb84493cde7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50680cfc97cf41c18d074cb84493cde7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50680cfc97cf41c18d074cb84493cde7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50680cfc97cf41c18d074cb84493cde7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 12:05:22.989604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-TestVolumeBootPattern-1045281 Jul 29 12:05:22.989604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 50680cfc97cf41c18d074cb84493cde7 Jul 29 12:05:22.989604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-TestVolumeBootPattern-1045281 Jul 29 12:05:22.989604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-TestVolumeBootPattern-1045281-project Jul 29 12:05:22.989604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 12:05:22.989604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 12:05:22.989604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 5f9d278bd76c4ce0b90b8307b3c7d1f2 Jul 29 12:05:22.989604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-TestVolumeBootPattern-1045281-project Jul 29 12:05:22.989604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 12:05:22.989604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance 9521a52e-c68c-4cff-9911-0f2ccf2fff68 could not be found. Jul 29 12:05:22.989604 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': '9521a52e-c68c-4cff-9911-0f2ccf2fff68'} Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9521a52e-c68c-4cff-9911-0f2ccf2fff68 could not be found. Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:05:22.990474 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9521a52e-c68c-4cff-9911-0f2ccf2fff68 could not be found. Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9521a52e-c68c-4cff-9911-0f2ccf2fff68 could not be found. Jul 29 12:05:22.992506 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 12:05:22.993838 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-b6e07a89-c6a7-44a6-a741-e750ffba1bb7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Returning 404 to user: Instance 9521a52e-c68c-4cff-9911-0f2ccf2fff68 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:05:22.993838 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-b6e07a89-c6a7-44a6-a741-e750ffba1bb7 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68" status: 404 len: 111 microversion: 2.1 time: 0.033343 Jul 29 12:05:22.993838 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 535/1055] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:05:22 2022] GET /compute/v2.1/servers/9521a52e-c68c-4cff-9911-0f2ccf2fff68 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:05:26.057224 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-1bfebae2-3414-4e6c-9baa-049f7abfabd2 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:05:26.057772 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-e81938b3-9372-47cb-8bf6-fcee5936bfee req-04bf0174-091b-4615-92c4-94f70547dfaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea055ff0-9a59-45aa-abbf-a283fdea0616", "tag": "e3f20048-10dc-4804-a4f8-bdf5a8ea8988"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:05:26.058146 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-1bfebae2-3414-4e6c-9baa-049f7abfabd2 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:05:26.065905 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1bfebae2-3414-4e6c-9baa-049f7abfabd2 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:26.066289 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1bfebae2-3414-4e6c-9baa-049f7abfabd2 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:26.067072 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1bfebae2-3414-4e6c-9baa-049f7abfabd2 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:26.067495 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-e81938b3-9372-47cb-8bf6-fcee5936bfee req-04bf0174-091b-4615-92c4-94f70547dfaa service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:26.068001 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-1bfebae2-3414-4e6c-9baa-049f7abfabd2 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:26.068127 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-e81938b3-9372-47cb-8bf6-fcee5936bfee req-04bf0174-091b-4615-92c4-94f70547dfaa service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:26.079901 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-e81938b3-9372-47cb-8bf6-fcee5936bfee req-04bf0174-091b-4615-92c4-94f70547dfaa service nova] Creating event network-changed:e3f20048-10dc-4804-a4f8-bdf5a8ea8988 for instance ea055ff0-9a59-45aa-abbf-a283fdea0616 on hv-cinder-83754 Jul 29 12:05:26.085701 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-e81938b3-9372-47cb-8bf6-fcee5936bfee req-04bf0174-091b-4615-92c4-94f70547dfaa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031764 Jul 29 12:05:26.086384 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 536/1056] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 12:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:05:26.101341 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-1bfebae2-3414-4e6c-9baa-049f7abfabd2 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Going to try to terminate instance {{(pid=129585) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:05:26.187610 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-1bfebae2-3414-4e6c-9baa-049f7abfabd2 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 204 len: 0 microversion: 2.1 time: 0.135305 Jul 29 12:05:26.189002 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 521/1057] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 12:05:26 2022] DELETE /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 12:05:26.197732 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-fc554c6e-fc85-4a6d-bebc-7b62648d6d80 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:05:26.198451 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-fc554c6e-fc85-4a6d-bebc-7b62648d6d80 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:05:26.205201 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fc554c6e-fc85-4a6d-bebc-7b62648d6d80 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:26.205675 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fc554c6e-fc85-4a6d-bebc-7b62648d6d80 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:26.206447 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fc554c6e-fc85-4a6d-bebc-7b62648d6d80 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:26.206875 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-fc554c6e-fc85-4a6d-bebc-7b62648d6d80 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:26.348057 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.policy [None req-fc554c6e-fc85-4a6d-bebc-7b62648d6d80 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129584) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:05:26.356757 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-fc554c6e-fc85-4a6d-bebc-7b62648d6d80 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1575 microversion: 2.1 time: 0.163377 Jul 29 12:05:26.357336 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 537/1058] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:05:26 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:05:27.379242 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-e07fb5e4-7a4a-484f-ae4f-586d68ab25da tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:05:27.379868 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-e07fb5e4-7a4a-484f-ae4f-586d68ab25da tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:05:27.386522 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e07fb5e4-7a4a-484f-ae4f-586d68ab25da tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:27.386985 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e07fb5e4-7a4a-484f-ae4f-586d68ab25da tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:27.387758 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e07fb5e4-7a4a-484f-ae4f-586d68ab25da tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:27.388200 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-e07fb5e4-7a4a-484f-ae4f-586d68ab25da tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:27.524752 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-e07fb5e4-7a4a-484f-ae4f-586d68ab25da tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:05:27.532409 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-e07fb5e4-7a4a-484f-ae4f-586d68ab25da tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1575 microversion: 2.1 time: 0.157520 Jul 29 12:05:27.533039 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 522/1059] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:05:27 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:05:28.408215 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [req-b4bdc2f0-61a4-4869-8f64-7327e491e6cf req-eb86c998-5904-4416-a1b7-718c3592d14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea055ff0-9a59-45aa-abbf-a283fdea0616", "name": "network-vif-deleted", "tag": "e3f20048-10dc-4804-a4f8-bdf5a8ea8988"}]} {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:05:28.418848 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-b4bdc2f0-61a4-4869-8f64-7327e491e6cf req-eb86c998-5904-4416-a1b7-718c3592d14d service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:28.419383 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [req-b4bdc2f0-61a4-4869-8f64-7327e491e6cf req-eb86c998-5904-4416-a1b7-718c3592d14d service nova] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:28.431496 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.compute.server_external_events [req-b4bdc2f0-61a4-4869-8f64-7327e491e6cf req-eb86c998-5904-4416-a1b7-718c3592d14d service nova] Creating event network-vif-deleted:e3f20048-10dc-4804-a4f8-bdf5a8ea8988 for instance ea055ff0-9a59-45aa-abbf-a283fdea0616 on hv-cinder-83754 Jul 29 12:05:28.436530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [req-b4bdc2f0-61a4-4869-8f64-7327e491e6cf req-eb86c998-5904-4416-a1b7-718c3592d14d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031946 Jul 29 12:05:28.437116 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 538/1060] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Jul 29 12:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:05:28.554589 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-daa674a4-0a12-440c-9b5d-42e760bbc55e tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:05:28.555200 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-daa674a4-0a12-440c-9b5d-42e760bbc55e tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:05:28.561866 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-daa674a4-0a12-440c-9b5d-42e760bbc55e tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:28.562316 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-daa674a4-0a12-440c-9b5d-42e760bbc55e tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:28.563088 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-daa674a4-0a12-440c-9b5d-42e760bbc55e tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:28.563522 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-daa674a4-0a12-440c-9b5d-42e760bbc55e tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:28.626612 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.policy [None req-daa674a4-0a12-440c-9b5d-42e760bbc55e tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d278bd76c4ce0b90b8307b3c7d1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50680cfc97cf41c18d074cb84493cde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129585) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:05:28.634228 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-daa674a4-0a12-440c-9b5d-42e760bbc55e tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 200 len: 1225 microversion: 2.1 time: 0.084265 Jul 29 12:05:28.635002 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 523/1061] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:05:28 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:05:29.657195 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-40dc15de-f434-4d95-b9a9-f0cf352ece68 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:05:29.657843 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-40dc15de-f434-4d95-b9a9-f0cf352ece68 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: ea055ff0-9a59-45aa-abbf-a283fdea0616] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:05:29.664223 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-40dc15de-f434-4d95-b9a9-f0cf352ece68 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:29.664710 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-40dc15de-f434-4d95-b9a9-f0cf352ece68 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:29.665504 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-40dc15de-f434-4d95-b9a9-f0cf352ece68 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:29.665951 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-40dc15de-f434-4d95-b9a9-f0cf352ece68 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:29.679877 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-40dc15de-f434-4d95-b9a9-f0cf352ece68 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] HTTP exception thrown: Instance ea055ff0-9a59-45aa-abbf-a283fdea0616 could not be found. Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-40dc15de-f434-4d95-b9a9-f0cf352ece68 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Request method failure captured: Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 HTTP/1.1 Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48tlTMWHn89BA2FxrwOAl6-QNLJieighQOiUUq2xzGstj7yIGuSiEf9yrfM61bGeJepoyf6BplrbddwukEnRH9edCjU_Cglq7_nheI6ATb6ZKzZeYODMDEwrmFTnEOPEFkFoW6CVpOgw5YeZoYEhCZN7DIyMGvkJidhswmwDPvFQs1Q Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 50680cfc97cf41c18d074cb84493cde7 Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-TestVolumeBootPattern-1045281 Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 12:05:29.681530 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 12:05:29.683254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50680cfc97cf41c18d074cb84493cde7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50680cfc97cf41c18d074cb84493cde7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50680cfc97cf41c18d074cb84493cde7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50680cfc97cf41c18d074cb84493cde7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 12:05:29.683254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-TestVolumeBootPattern-1045281 Jul 29 12:05:29.683254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 50680cfc97cf41c18d074cb84493cde7 Jul 29 12:05:29.683254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-TestVolumeBootPattern-1045281 Jul 29 12:05:29.683254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-TestVolumeBootPattern-1045281-project Jul 29 12:05:29.683254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 12:05:29.683254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 12:05:29.683254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 5f9d278bd76c4ce0b90b8307b3c7d1f2 Jul 29 12:05:29.683254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-TestVolumeBootPattern-1045281-project Jul 29 12:05:29.683254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 12:05:29.683254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance ea055ff0-9a59-45aa-abbf-a283fdea0616 could not be found. Jul 29 12:05:29.683254 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': 'ea055ff0-9a59-45aa-abbf-a283fdea0616'} Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea055ff0-9a59-45aa-abbf-a283fdea0616 could not be found. Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:05:29.684317 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea055ff0-9a59-45aa-abbf-a283fdea0616 could not be found. Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea055ff0-9a59-45aa-abbf-a283fdea0616 could not be found. Jul 29 12:05:29.686029 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 12:05:29.687788 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-40dc15de-f434-4d95-b9a9-f0cf352ece68 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Returning 404 to user: Instance ea055ff0-9a59-45aa-abbf-a283fdea0616 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:05:29.687788 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-40dc15de-f434-4d95-b9a9-f0cf352ece68 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616" status: 404 len: 111 microversion: 2.1 time: 0.030706 Jul 29 12:05:29.687788 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 539/1062] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:05:29 2022] GET /compute/v2.1/servers/ea055ff0-9a59-45aa-abbf-a283fdea0616 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:05:30.120712 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8c4f3390-6c31-4a38-81fb-2f15feb61d00 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:05:30.121259 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.compute.api [None req-8c4f3390-6c31-4a38-81fb-2f15feb61d00 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129585) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:05:30.127842 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8c4f3390-6c31-4a38-81fb-2f15feb61d00 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:30.128296 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8c4f3390-6c31-4a38-81fb-2f15feb61d00 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:30.129058 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8c4f3390-6c31-4a38-81fb-2f15feb61d00 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:30.129535 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG oslo_concurrency.lockutils [None req-8c4f3390-6c31-4a38-81fb-2f15feb61d00 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:30.142966 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.wsgi [None req-8c4f3390-6c31-4a38-81fb-2f15feb61d00 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] HTTP exception thrown: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8c4f3390-6c31-4a38-81fb-2f15feb61d00 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Request method failure captured: Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: request: DELETE /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 HTTP/1.1 Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept: application/json Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Accept-Encoding: identity Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Connection: close Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Length: 0 Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Content-Type: application/json Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Host: 10.222.0.60 Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Openstack-System-Scope: None Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: User-Agent: python-urllib3/1.26.10 Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Auth-Token: gAAAAABi48tlTMWHn89BA2FxrwOAl6-QNLJieighQOiUUq2xzGstj7yIGuSiEf9yrfM61bGeJepoyf6BplrbddwukEnRH9edCjU_Cglq7_nheI6ATb6ZKzZeYODMDEwrmFTnEOPEFkFoW6CVpOgw5YeZoYEhCZN7DIyMGvkJidhswmwDPvFQs1Q Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Id: None Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Domain-Name: None Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Identity-Status: Confirmed Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Is-Admin-Project: True Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Id: default Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Domain-Name: Default Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Id: 50680cfc97cf41c18d074cb84493cde7 Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Project-Name: tempest-TestVolumeBootPattern-1045281 Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Role: reader,member Jul 29 12:05:30.144641 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Roles: reader,member Jul 29 12:05:30.146367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50680cfc97cf41c18d074cb84493cde7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50680cfc97cf41c18d074cb84493cde7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50680cfc97cf41c18d074cb84493cde7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50680cfc97cf41c18d074cb84493cde7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 12:05:30.146367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant: tempest-TestVolumeBootPattern-1045281 Jul 29 12:05:30.146367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Id: 50680cfc97cf41c18d074cb84493cde7 Jul 29 12:05:30.146367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-Tenant-Name: tempest-TestVolumeBootPattern-1045281 Jul 29 12:05:30.146367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User: tempest-TestVolumeBootPattern-1045281-project Jul 29 12:05:30.146367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Id: default Jul 29 12:05:30.146367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Domain-Name: Default Jul 29 12:05:30.146367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Id: 5f9d278bd76c4ce0b90b8307b3c7d1f2 Jul 29 12:05:30.146367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: X-User-Name: tempest-TestVolumeBootPattern-1045281-project Jul 29 12:05:30.146367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: method: > Jul 29 12:05:30.146367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: exception: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. Jul 29 12:05:30.146367 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: action_args: {'id': 'cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131'} Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:05:30.148045 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. Jul 29 12:05:30.149689 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: ERROR nova.api.openstack.wsgi Jul 29 12:05:30.151794 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-8c4f3390-6c31-4a38-81fb-2f15feb61d00 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Returning 404 to user: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. {{(pid=129585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:05:30.151794 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-8c4f3390-6c31-4a38-81fb-2f15feb61d00 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 404 len: 111 microversion: 2.1 time: 0.029955 Jul 29 12:05:30.151794 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 524/1063] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Jul 29 12:05:30 2022] DELETE /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:05:30.155191 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-52ad3417-9dca-48fc-80fe-e69d7f4d2e8a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '>' {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:05:30.155814 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.compute.api [None req-52ad3417-9dca-48fc-80fe-e69d7f4d2e8a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] [instance: cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131] Fetching instance by UUID {{(pid=129584) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:05:30.161919 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-52ad3417-9dca-48fc-80fe-e69d7f4d2e8a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:30.162373 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-52ad3417-9dca-48fc-80fe-e69d7f4d2e8a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:30.163709 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-52ad3417-9dca-48fc-80fe-e69d7f4d2e8a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:05:30.164151 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG oslo_concurrency.lockutils [None req-52ad3417-9dca-48fc-80fe-e69d7f4d2e8a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Lock "606e82e5-84db-457f-9bee-6019fb6dd605" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:05:30.177391 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.wsgi [None req-52ad3417-9dca-48fc-80fe-e69d7f4d2e8a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] HTTP exception thrown: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-52ad3417-9dca-48fc-80fe-e69d7f4d2e8a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Request method failure captured: Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: request: GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 HTTP/1.1 Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept: application/json Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Accept-Encoding: identity Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Connection: close Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Length: 0 Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Content-Type: application/json Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Host: 10.222.0.60 Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Openstack-System-Scope: None Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: User-Agent: python-urllib3/1.26.10 Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Auth-Token: gAAAAABi48tlTMWHn89BA2FxrwOAl6-QNLJieighQOiUUq2xzGstj7yIGuSiEf9yrfM61bGeJepoyf6BplrbddwukEnRH9edCjU_Cglq7_nheI6ATb6ZKzZeYODMDEwrmFTnEOPEFkFoW6CVpOgw5YeZoYEhCZN7DIyMGvkJidhswmwDPvFQs1Q Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Id: None Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Domain-Name: None Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Identity-Status: Confirmed Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Is-Admin-Project: True Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Id: default Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Domain-Name: Default Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Id: 50680cfc97cf41c18d074cb84493cde7 Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Project-Name: tempest-TestVolumeBootPattern-1045281 Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Role: reader,member Jul 29 12:05:30.178990 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Roles: reader,member Jul 29 12:05:30.180849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50680cfc97cf41c18d074cb84493cde7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_50680cfc97cf41c18d074cb84493cde7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/50680cfc97cf41c18d074cb84493cde7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/50680cfc97cf41c18d074cb84493cde7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 29 12:05:30.180849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant: tempest-TestVolumeBootPattern-1045281 Jul 29 12:05:30.180849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Id: 50680cfc97cf41c18d074cb84493cde7 Jul 29 12:05:30.180849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-Tenant-Name: tempest-TestVolumeBootPattern-1045281 Jul 29 12:05:30.180849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User: tempest-TestVolumeBootPattern-1045281-project Jul 29 12:05:30.180849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Id: default Jul 29 12:05:30.180849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Domain-Name: Default Jul 29 12:05:30.180849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Id: 5f9d278bd76c4ce0b90b8307b3c7d1f2 Jul 29 12:05:30.180849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: X-User-Name: tempest-TestVolumeBootPattern-1045281-project Jul 29 12:05:30.180849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: method: > Jul 29 12:05:30.180849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: exception: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. Jul 29 12:05:30.180849 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: action_args: {'id': 'cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131'} Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: {{(pid=129584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:05:30.182014 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. Jul 29 12:05:30.183653 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: ERROR nova.api.openstack.wsgi Jul 29 12:05:30.185455 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: DEBUG nova.api.openstack.wsgi [None req-52ad3417-9dca-48fc-80fe-e69d7f4d2e8a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Returning 404 to user: Instance cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 could not be found. {{(pid=129584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:05:30.185455 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO nova.api.openstack.requestlog [None req-52ad3417-9dca-48fc-80fe-e69d7f4d2e8a tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131" status: 404 len: 111 microversion: 2.1 time: 0.029108 Jul 29 12:05:30.185455 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: [pid: 129584|app: 0|req: 540/1064] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Jul 29 12:05:30 2022] GET /compute/v2.1/servers/cf4e65d8-9d68-4cf4-bd4f-7f5d08c6d131 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:05:31.484039 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: DEBUG nova.api.openstack.wsgi [None req-264b69fc-86ac-416f-857f-73f8f74a90c8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] Calling method '.version_select at 0x7f68fa098ee0>' {{(pid=129585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:05:31.510654 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO nova.api.openstack.requestlog [None req-264b69fc-86ac-416f-857f-73f8f74a90c8 tempest-TestVolumeBootPattern-1045281 tempest-TestVolumeBootPattern-1045281-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1597632429" status: 202 len: 0 microversion: 2.1 time: 0.030339 Jul 29 12:05:31.511449 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: [pid: 129585|app: 0|req: 525/1065] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Jul 29 12:05:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1597632429 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:06:41.244427 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 12:06:41.244987 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Fri Jul 29 12:06:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 12:08:11.495705 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 12:08:11.496383 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Fri Jul 29 12:08:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 12:08:16.018616 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 12:08:16.019451 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Fri Jul 29 12:08:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 12:08:18.147669 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 12:08:18.148208 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Fri Jul 29 12:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 12:08:35.350148 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 12:08:35.350716 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Fri Jul 29 12:08:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 12:08:40.147504 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 12:08:40.147910 dv-cinder-837542-7-iscsi devstack@n-api.service[129585]: Fri Jul 29 12:08:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 12:10:01.253217 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 12:10:01.253764 dv-cinder-837542-7-iscsi devstack@n-api.service[129584]: Fri Jul 29 12:10:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!